Skip to main content

Extract and modify HTML/CSS URLs, translate HTML documents <-> list data structures.

Project description

The htmldata module allows one to translate HTML documents back and forth to list data structures. This allows for programmatic reading and writing of HTML documents, with much flexibility.

Functions are also available for extracting and/or modifying all URLs present in the HTML or stylesheets of a document.

I have found this library useful for writing robots, for “wrapping” all of the URLs on websites inside my own proxy CGI script, for filtering HTML, and for doing flexible wget-like mirroring.

It keeps things as simple as possible, so it should be easy to learn.

Supports XHTML, too.

Project details

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page