A Python package to check URLs against a robots.txt file.
Project description
Robots Text Processor
This is a package to handle processing of robots.txt files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-0.0.6.tar.gz
(4.0 kB
view hashes)
Built Distribution
Close
Hashes for robotstxt-0.0.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c691bcb817677cffc48a633033aca34979eae518cde883d90b5fd8420f5b22c9 |
|
MD5 | 8d031544ff59f9362eff3b457928acdc |
|
BLAKE2b-256 | f7472ee8f797453002108d73c13d197f0f906b163e92d2776db4461a75c5c107 |