Last released May 6, 2023
None
Last released Nov 9, 2021
rbdt is a python library (written in rust) for parsing robots.txt files for large scale batch processing.
Supported by