A Python package to check URLs against a robots.txt file.
Project description
Robots Text Processor
This is a package to handle processing of robots.txt files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-0.0.7.tar.gz
(4.0 kB
view hashes)
Built Distribution
Close
Hashes for robotstxt-0.0.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b38768fb3990dbe64360ab515026f9ef5d9b6007535806ca43c18c3cf6602be0 |
|
MD5 | ea5b021fe495eac0c0c1a691bf095a7f |
|
BLAKE2b-256 | fa791861b46bfcabf74ff56eadce7538dc7771499924298731846696a2139625 |