Utilities for spider.
Project description
Spider Utility
Utilities for spider, including connectors to databases, path generators, loggers and exceptions.
Docs
Connector
MongoDB
Redis
LocalFolder
LocalFile
Network
Session
User Agent
Path Generator
Store Simply
Store By UserName
Store By User Name Per Folder
Data Structure
Dict
TextDict
Log
Logger
Exceptions
Typing
Media Type
Recommend packages
-
BeautidfulSoup: beautifulsoup4
-
Parsel: parsel
-
Brotli: brotli
How to contribute
Distribute
Refer to the official doc: https://packaging.python.org/guides/distributing-packages-using-setuptools/
python setup.py sdist
python setup.py bdist_wheel --universal
twine upload dist/*
Todo
-
Fulfill the docs
-
Multi-thread / multi-processing / Asycio
-
Decorator
-
Monitor
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
spiderutil-0.1.6.tar.gz
(8.6 kB
view hashes)
Built Distribution
Close
Hashes for spiderutil-0.1.6-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f46b5e662e51947655ba61d3a0fabd9cb256df9fa1c401e4aa056f2e7f0e3ed6 |
|
MD5 | 451e50b58ff20eabcfe722d821bba318 |
|
BLAKE2b-256 | 67a74845c415f24aa37b62ad4c8f1c3c2e2d740638487c6ec427f43e967e0df6 |