a hobby crawler
A Hobby Crawler. It is almost under construction.
$ pip install bamboo-crawler
$ bamboo --recipe recipe.yml
mytask: input: type: ConstantInputter options: value: http://httpbin.org/robots.txt process: type: HTTPCrawler output: type: StdoutOutputter
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.