tool set for crawler project.
Project description
Welcome to crawlib Documentation
Crawl library provides crawler project building block to simplify:
url encoding.
html parse.
error handling.
download html and file.
request cache.
Quick Links
Install
crawlib is released on PyPI, so all you need is:
$ pip install crawlibTo upgrade to latest version:
$ pip install --upgrade crawlibRelease history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
crawlib-0.0.20.tar.gz
(80.5 kB
view details)
Built Distribution
crawlib-0.0.20-py2-none-any.whl
(183.8 kB
view details)
File details
Details for the file crawlib-0.0.20.tar.gz.
File metadata
- Download URL: crawlib-0.0.20.tar.gz
- Upload date:
- Size: 80.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 05cc683bf0a5cae613a0ae9a0cefc397773dcf8a762c28607d5288491dbddcae |
|
| MD5 | d4537890494dc84aa0f1e7868da4f443 |
|
| BLAKE2b-256 | a08c18d6f9bba26e3a8403375d0b613f5eae3433b7b6bd6caacc0a9339f29b37 |
File details
Details for the file crawlib-0.0.20-py2-none-any.whl.
File metadata
- Download URL: crawlib-0.0.20-py2-none-any.whl
- Upload date:
- Size: 183.8 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f9197cc62d7a763a635d152c8354a13f7f8e304c24769bd43eb7cac4a5e053d9 |
|
| MD5 | 9d5bb893f8149b3c3d0f1a7b97dc7355 |
|
| BLAKE2b-256 | a94944e3386c673e945b69339dd4dccae2798646c248b404a0e879c7034ea7a4 |
