tool set for crawler project.
Project description
Welcome to crawlib Documentation
Crawl library provides crawler project building block to simplify:
url encoding.
html parse.
error handling.
download html and file.
request cache.
Quick Links
Install
crawlib is released on PyPI, so all you need is:
$ pip install crawlibTo upgrade to latest version:
$ pip install --upgrade crawlibRelease history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
crawlib-0.0.17.tar.gz
(69.7 kB
view details)
Built Distribution
crawlib-0.0.17-py2-none-any.whl
(164.4 kB
view details)
File details
Details for the file crawlib-0.0.17.tar.gz.
File metadata
- Download URL: crawlib-0.0.17.tar.gz
- Upload date:
- Size: 69.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 398c3459c70fe78989612a8338c03170a4db36ff286cc50e0938a99b0a06e6ae |
|
| MD5 | 7e43a06259fe37e81df355c092f4973d |
|
| BLAKE2b-256 | d2139ed96d3f1b9b4f40dba50451cd8d863b6e389c25ad19486d348bba30d93b |
File details
Details for the file crawlib-0.0.17-py2-none-any.whl.
File metadata
- Download URL: crawlib-0.0.17-py2-none-any.whl
- Upload date:
- Size: 164.4 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bc80c02cfa062ab1d81665a3b1f122156d8241a9245f9b4793f7afae4624327c |
|
| MD5 | 12f5f740399c801b9d2a073953e56f09 |
|
| BLAKE2b-256 | 692fe705feec4bf83226eaea97089f7c0467f48619b8693f563d72b210d72ca4 |
