A package to check URLs against a robots.txt file
Project description
Robots Text Processor
This is a package to handle processing of robots.txt files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-0.0.1.tar.gz
(3.7 kB
view hashes)
Built Distribution
Close
Hashes for robotstxt-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63b6f58fd78c8987f3db7af6f6a0cbfd61d366fc5f61ba7993d9c769996e3081 |
|
MD5 | 7899f40740565bdf508338946f09d43e |
|
BLAKE2b-256 | 2f4832562c069622d056b26ac92516692a479d6bb8929528f9291c3227f1ae1f |