a hobby crawler
Project description
Bamboo Crawler
Deprecation Notice
This project is deprecated. No longer maintained. I don't use this project anymore. If you want to use this project, please fork it.
A Hobby Crawler. It is almost under construction.
Usage
Installation
$ pip install bamboo-crawler
Run
$ bamboo --recipe recipe.yml
Recipe
mytask:
input:
type: ConstantInputter
options:
value: http://httpbin.org/robots.txt
process:
type: HTTPCrawler
output:
type: StdoutOutputter
License
BSD-3-Clause License
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bamboo-crawler-0.2.1.tar.gz
(98.8 kB
view details)
Built Distribution
File details
Details for the file bamboo-crawler-0.2.1.tar.gz.
File metadata
- Download URL: bamboo-crawler-0.2.1.tar.gz
- Upload date:
- Size: 98.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d65f7aaed4eac78a0e49c47b88cc50e64551c48044e0c14702e48d94dd4a5daf |
|
| MD5 | edc678b082a7764fa89a4775c2512f54 |
|
| BLAKE2b-256 | 79e7f3a881c19d495bc1f8da28e322c43c7da3a6a86c4cfa7e58b3dc85f5fccf |
File details
Details for the file bamboo_crawler-0.2.1-py3-none-any.whl.
File metadata
- Download URL: bamboo_crawler-0.2.1-py3-none-any.whl
- Upload date:
- Size: 6.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1618cea3101a708bff8f92405123d9fc4dc95744b6b43cbc7b7149ea643735d6 |
|
| MD5 | f34818e49c2e504101818c639970625e |
|
| BLAKE2b-256 | 9d24f0b82e9e105a757c2eb3a57556c45985e40ea1ff0649324b3e8625b623d4 |
