a hobby crawler
Project description
Bamboo Crawler
A Hobby Crawler. It is almost under construction.
Usage
Installation
$ pip install bamboo-crawler
Run
$ bamboo --recipe recipe.yml
Recipe
mytask:
input:
type: ConstantInputter
options:
value: http://httpbin.org/robots.txt
process:
type: HTTPCrawler
output:
type: StdoutOutputter
License
BSD-3-Clause License
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bamboo-crawler-0.1.3.zip
(22.6 kB
view details)
File details
Details for the file bamboo-crawler-0.1.3.zip.
File metadata
- Download URL: bamboo-crawler-0.1.3.zip
- Upload date:
- Size: 22.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/33.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 60a576e05d3e73bc124967f285593fe6854e9e166114c3a98c54087eab118045 |
|
| MD5 | 5a070f46cb4f9b05789b0eddb23f529d |
|
| BLAKE2b-256 | a503580b8b4fff30e8ddc37500d33766f603b0f88d724a00dfd62d42dca98bd3 |
