Utilities for spider.
Project description
Spider Utility
Utilities for spider.
Features
- Database connector
- Local file path generator
- Network session
- Data structure
- Log
- Exception
Installation
pip install spiderutil
Documentation
Still working...
Examples
Still working...
How to contribute
Open a new issue when you have questions, advices, or you encounter a bug.
Recommend packages
Parsers
- beautifulsoup4: parse the webpage like a tree.
pip install beautifulsoup4
- scrapy/parsel: Parse webpage with XPath or CSS selectors.
pip install parsel
Encoding and Decoding
- google/brotli: decode brotli encoding.
pip install brotli
Database
- SQLAlchemy: Process the SQL statement like object
pip install SQLAlchemy
- PyMySQL: Connect to MySQL
pip install pymysql
- mkleehammer/pyodbc: Connect to Microsoft SQL Server
pip install pyodbc
In addition to: level12/sqlalchemy_pyodbc_mssql.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size spiderutil-0.1.8-py2.py3-none-any.whl (16.5 kB) | File type Wheel | Python version py2.py3 | Upload date | Hashes View |
| Filename, size spiderutil-0.1.8.tar.gz (11.5 kB) | File type Source | Python version None | Upload date | Hashes View |
Close
Hashes for spiderutil-0.1.8-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | baaf9954c018fb29f97d997b256f9a9d9287d4f324872c88965a8c80afb0ac68 |
|
| MD5 | 598b61296174564282cc38b7223a290f |
|
| BLAKE2-256 | f8b875fbf6eac1ac4fe319521f0b4813effd2cdc9c0048231ff0109fc5cec6d4 |
