Utilities for spider.
Project description
Spider Utility
Utilities for spider.
Features
- Database connector
- Local file path generator
- Network session
- Data structure
- Log
- Exception
Installation
pip install spiderutil
Documentation
Still working...
Examples
Still working...
How to contribute
Open a new issue when you have questions, advices, or you encounter a bug.
Recommend packages
Parsers
- beautifulsoup4: parse the webpage like a tree.
pip install beautifulsoup4
- scrapy/parsel: Parse webpage with XPath or CSS selectors.
pip install parsel
Encoding and Decoding
- google/brotli: decode brotli encoding.
pip install brotli
Database
- SQLAlchemy: Process the SQL statement like object
pip install SQLAlchemy
- PyMySQL: Connect to MySQL
pip install pymysql
- mkleehammer/pyodbc: Connect to Microsoft SQL Server
pip install pyodbc
In addition to: level12/sqlalchemy_pyodbc_mssql.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
spiderutil-0.1.8.tar.gz
(11.5 kB
view hashes)
Built Distribution
Close
Hashes for spiderutil-0.1.8-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | baaf9954c018fb29f97d997b256f9a9d9287d4f324872c88965a8c80afb0ac68 |
|
MD5 | 598b61296174564282cc38b7223a290f |
|
BLAKE2b-256 | f8b875fbf6eac1ac4fe319521f0b4813effd2cdc9c0048231ff0109fc5cec6d4 |