This code is under the Apache License 2.0. http://www.apache.org/licenses/LICENSE-2.0
This is a python port of a ruby port of arc90’s readability project
http://lab.arc90.com/experiments/readability/
In few words, Given a html document, it pulls out the main body text and cleans it up. It also can clean up title based on latest readability.js code.
- Based on:
Latest readability.js ( https://github.com/MHordecki/readability-redux/blob/master/readability/readability.js )
Ruby port by starrhorne and iterationlabs
Python port by gfxmonk ( https://github.com/gfxmonk/python-readability , based on BeautifulSoup )
Decruft effort to move to lxml ( http://www.minvolai.com/blog/decruft-arc90s-readability-in-python/ )
“BR to P” fix from readability.js which improves quality for smaller texts.
Github users contributions.
Installation:
easy_install readability-lxml or pip install readability-lxml
Usage:
from readability.readability import Document import urllib html = urllib.urlopen(url).read() readable_article = Document(html).summary() readable_title = Document(html).short_title()
Command-line usage:
python -m readability.readability -u http://pypi.python.org/pypi/readability-lxml
To open resulting page in browser:
python -m readability.readability -b -u http://pypi.python.org/pypi/readability-lxml
Using positive/negative keywords example:
python -m readability.readability -p intro -n newsindex,homepage-box,news-section -u http://python.org
Document() kwarg options:
attributes:
debug: output debug messages
min_text_length:
retry_length:
url: will allow adjusting links to be absolute
positive_keywords: the list of positive search patterns in classes and ids, for example: [“news-item”, “block”]
negative_keywords: the list of negative search patterns in classes and ids, for example: [“mysidebar”, “related”, “ads”]
Updates
0.3 Added Document.encoding, positive_keywords and negative_keywords
0.4 Added Videos loading and allowed more images per paragraph
0.5 Preparing a release to support Python versions 2.6, 2.7, 3.3 and 3.4
0.6 Finally a release which supports Python versions 2.6, 2.7, 3.3 and 3.4
Metadata
Release files for readability-lxml 0.6.0.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| readability-lxml-0.6.0.5.tar.gz | 13.7 kB | Without provenance | Details for readability-lxml-0.6.0.5.tar.gz |
Release files / readability-lxml-0.6.0.5.tar.gz
| Download URL | readability-lxml-0.6.0.5.tar.gz |
|---|---|
| Size | 13.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7531a0fa1adb72db3ee94cf919d92d87d9157fea677ba825c8bee227b5aa2423
|
|
BLAKE2b-256 checksum How to use checksums |
beaa5932f336386621d59e95efa9c0c76dc20abc697d01da3b659a9d077e4f20
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Security for readability-lxml 0.6.0.5
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.