Skip to main content

This code is under the Apache License 2.0. http://www.apache.org/licenses/LICENSE-2.0

This is a python port of a ruby port of arc90’s readability project

http://lab.arc90.com/experiments/readability/

In few words, Given a html document, it pulls out the main body text and cleans it up. It also can clean up title based on latest readability.js code.

Based on:

Installation:

easy_install readability-lxml
or
pip install readability-lxml

Usage:

from readability.readability import Document
import urllib
html = urllib.urlopen(url).read()
readable_article = Document(html).summary()
readable_title = Document(html).short_title()

Command-line usage:

python -m readability.readability -u http://pypi.python.org/pypi/readability-lxml

To open resulting page in browser:

python -m readability.readability -b -u http://pypi.python.org/pypi/readability-lxml

Using positive/negative keywords example:

python -m readability.readability -p intro -n newsindex,homepage-box,news-section -u http://python.org

Document() kwarg options:

  • attributes:

  • debug: output debug messages

  • min_text_length:

  • retry_length:

  • url: will allow adjusting links to be absolute

  • positive_keywords: the list of positive search patterns in classes and ids, for example: [“news-item”, “block”]

  • negative_keywords: the list of negative search patterns in classes and ids, for example: [“mysidebar”, “related”, “ads”]

Updates

  • 0.3 Added Document.encoding, positive_keywords and negative_keywords

  • 0.4 Added Videos loading and allowed more images per paragraph

  • 0.5 Preparing a release to support Python versions 2.6, 2.7, 3.3 and 3.4

  • 0.6 Finally a release which supports Python versions 2.6, 2.7, 3.3 and 3.4

Metadata

Release files for readability-lxml 0.6.0.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for readability-lxml 0.6.0.5
File Size Uploaded Provenance Actions
readability-lxml-0.6.0.5.tar.gz 13.7 kB Without provenance Details for readability-lxml-0.6.0.5.tar.gz

Release files / readability-lxml-0.6.0.5.tar.gz

Download URL readability-lxml-0.6.0.5.tar.gz
Size 13.7 kB
Tags Source
SHA-256 checksum
How to use checksums
7531a0fa1adb72db3ee94cf919d92d87d9157fea677ba825c8bee227b5aa2423
BLAKE2b-256 checksum
How to use checksums
beaa5932f336386621d59e95efa9c0c76dc20abc697d01da3b659a9d077e4f20
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for readability-lxml 0.6.0.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page