tool set for crawler project.
Project description
Welcome to crawlib Documentation
Crawl library provides crawler project building block to simplify:
url encoding.
html parse.
error handling.
download html and file.
request cache.
Quick Links
Install
crawlib is released on PyPI, so all you need is:
$ pip install crawlibTo upgrade to latest version:
$ pip install --upgrade crawlibRelease history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
crawlib-0.0.18.tar.gz
(77.1 kB
view details)
Built Distribution
crawlib-0.0.18-py2-none-any.whl
(176.5 kB
view details)
File details
Details for the file crawlib-0.0.18.tar.gz.
File metadata
- Download URL: crawlib-0.0.18.tar.gz
- Upload date:
- Size: 77.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8afd6dc7c22fbbdd4d1ae1dbcc236e6b75723d6e674aa4d0eade54a2c2718e65 |
|
| MD5 | ae77664fcd7dff3be5077940e1698cae |
|
| BLAKE2b-256 | 97452b4ad49afc7bd490619ccc9a85d1efff4b9d8f8227e304015babe61c3f8d |
File details
Details for the file crawlib-0.0.18-py2-none-any.whl.
File metadata
- Download URL: crawlib-0.0.18-py2-none-any.whl
- Upload date:
- Size: 176.5 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 356e87ef7bcf430d4d3573db529fe55e0d8b12fbd1a7c87ec56a8afb68d8e383 |
|
| MD5 | d4a6999c72f26486f97b47a5ca21ad0a |
|
| BLAKE2b-256 | 44ac10f056103a7073e4f98a0827aef4df0d6826575e03c7af9104af838169e6 |
