A Python package to check URL paths against robots directives a robots.txt file.
Project description
Robots Text Processor
This is a Python package to check URL paths against robots directives a robots.txt file.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
robotstxt-1.0.3.tar.gz
(6.4 kB
view details)
File details
Details for the file robotstxt-1.0.3.tar.gz.
File metadata
- Download URL: robotstxt-1.0.3.tar.gz
- Upload date:
- Size: 6.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.9.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 92d58f67b78e85f0a2c903877a7664c45ceebf04418f536c2a523f4d4641db28 |
|
| MD5 | 9b650a8cb7d61fac13dd5e3e1da97789 |
|
| BLAKE2b-256 | 61a934e48897dd608c9b71639c97ae61726e2d159544e5d1c9f8273a4fb8b8a7 |
