A Python package to check URLs against a robots.txt file.
Project description
Robots Text Processor
This is a package to handle processing of robots.txt files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-0.0.8.tar.gz
(4.0 kB
view hashes)
Built Distribution
Close
Hashes for robotstxt-0.0.8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9c07a13dad8a1996396ce07cfd812b0e2d69bffa2c7d26e3382294acaeb6dac5 |
|
MD5 | 379f16e17598d34cb849b24724e89692 |
|
BLAKE2b-256 | 46668ab54cc10cd7301a47831a9f2381e8d7f0cdfae8113c28dea2918d35ce7f |