Spider Utility
Utilities for spider.
Features
- Database connector
- Local file path generator
- Network session
- Data structure
- Log
- Exception
Installation
pip install spiderutil
Documentation
Still working...
Examples
Still working...
How to contribute
Open a new issue when you have questions, advices, or you encounter a bug.
Recommend packages
Parsers
- beautifulsoup4: parse the webpage like a tree.
pip install beautifulsoup4
- scrapy/parsel: Parse webpage with XPath or CSS selectors.
pip install parsel
Encoding and Decoding
- google/brotli: decode brotli encoding.
pip install brotli
Database
- SQLAlchemy: Process the SQL statement like object
pip install SQLAlchemy
- PyMySQL: Connect to MySQL
pip install pymysql
- mkleehammer/pyodbc: Connect to Microsoft SQL Server
pip install pyodbc
In addition to: level12/sqlalchemy_pyodbc_mssql.
1 maintainer
Metadata
1 maintainer
Release files for spiderutil 0.1.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| spiderutil-0.1.8.tar.gz | 11.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| spiderutil-0.1.8-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details |
Total release size: 28.0 kB
Release files / spiderutil-0.1.8.tar.gz
| Download URL | spiderutil-0.1.8.tar.gz |
|---|---|
| Size | 11.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
dbdb0d2a0051ae84d1f505719f1651dd38893205859887e07bee011222aa9f6b
|
|
BLAKE2b-256 checksum How to use checksums |
bc564483a917741a7f6e2c48398ba93fdb722a18a607eee5ba40cf5b6b3745bd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.0.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.3
|
Release files / spiderutil-0.1.8-py2.py3-none-any.whl
| Download URL | spiderutil-0.1.8-py2.py3-none-any.whl |
|---|---|
| Size | 16.5 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
baaf9954c018fb29f97d997b256f9a9d9287d4f324872c88965a8c80afb0ac68
|
|
BLAKE2b-256 checksum How to use checksums |
f8b875fbf6eac1ac4fe319521f0b4813effd2cdc9c0048231ff0109fc5cec6d4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.0.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0.post20200309 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.3
|
