pyburrow

Some features may not work without JavaScript. Please try enabling it if you encounter problems.

Pre-release

This release is a pre-release and may not be stable for production use.

pyburrow is a Python 3 library for crawling websites: capturing, archiving and processing their resources. It is different from all other known crawlers by being very low level: the HTTP response body is stored as raw unencoded bytes, and further the HTTP response headers and status codes are stored as well. The resulting rich data set is a trove for data mining and analysis.