A package to check URLs against a robots.txt file
Project description
Robots Text Processor
This is a package to handle processing of robots.txt files.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-0.0.3.tar.gz
(3.9 kB
view hashes)
Built Distribution
Close
Hashes for robotstxt-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c6fe642ada4d8fa4aae655f89a99913f2e6abf9e35e15947bcaa60983a6a0611 |
|
MD5 | e0f0bba988f21adb032317fc48ce2622 |
|
BLAKE2b-256 | 1309a2f02c30caa592f43bc74a7922d6a0a70b63b80b7912fe62e4535349925e |