tool set for crawler project.
Project description
Welcome to crawlib Documentation
Crawl library provides crawler project building block to simplify:
url encoding.
html parse.
error handling.
download html and file.
request cache.
Quick Links
Install
crawlib is released on PyPI, so all you need is:
$ pip install crawlibTo upgrade to latest version:
$ pip install --upgrade crawlibRelease history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
crawlib-0.0.23.tar.gz
(82.1 kB
view details)
Built Distribution
crawlib-0.0.23-py2-none-any.whl
(188.6 kB
view details)
File details
Details for the file crawlib-0.0.23.tar.gz.
File metadata
- Download URL: crawlib-0.0.23.tar.gz
- Upload date:
- Size: 82.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | be06c627d9454f57f21b40ef3abd8fdf54d73630b1e3b3d6cdc0f36f7b6c7d6e |
|
| MD5 | 0bd15ebc18b4ec539ae5e2e649da6a49 |
|
| BLAKE2b-256 | 49813fc19e6c16a657a3fbcfd647bebf632bcc18970e8e6ca783634111b732a9 |
File details
Details for the file crawlib-0.0.23-py2-none-any.whl.
File metadata
- Download URL: crawlib-0.0.23-py2-none-any.whl
- Upload date:
- Size: 188.6 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/2.7.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1e5c9a2390b661332e42018ef8ed4730d07124b1d435c74dc79d7e9d67c1816f |
|
| MD5 | 19b451657114b1954c9ddc857b168d7d |
|
| BLAKE2b-256 | 0af28620ab872e424af05290d6fb86a3eacd7070d9f93b5db3336e67bc83b214 |
