urltotext
A light weight library that takes in a url and extracts any readable text in it.
Accepting any and all PRs!
Installation
pip install urltotext
Pre-requisites
urltotextusesseleniumwith the driver scope currently limited tochromeonly. Please ensure that chromedriver is properly configured. Use this link for installation instructions.
Usage
- Import and initialize ContentFinder
from urltotext import ContentFinder
cf = ContentFinder
- Scrape a url
# scrape a url
cs.scrape_url(url="your_url_here")
# print the article
cs.print_article(url="your_url_here")
# all urls passed will be stored in the class instance.
# use the flush_data method to free memory
cs.flush_data()
Enjoy!
1 maintainer
Metadata
1 maintainer
Release files for urltotext 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| urltotext-0.2.0.tar.gz | 15.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| urltotext-0.2.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 31.5 kB
Release files / urltotext-0.2.0.tar.gz
| Download URL | urltotext-0.2.0.tar.gz |
|---|---|
| Size | 15.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
765289b11e0f17aaa4e4a0d9c060c793a72790ffbeb6ebc1cf293ad8bb66e26b
|
|
BLAKE2b-256 checksum How to use checksums |
cbfaf44d2cdb1e297e96991add9a55e36f9134f72df7ef97b3e91e8ef37bd799
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|
Release files / urltotext-0.2.0-py3-none-any.whl
| Download URL | urltotext-0.2.0-py3-none-any.whl |
|---|---|
| Size | 15.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9358c51e3ec0a88ff8f0905df1cb6853cc403d56d15dd5c58e50a8712732a996
|
|
BLAKE2b-256 checksum How to use checksums |
1bcc26c5ef6a05e44e1cf12f081aa6b6eaf24a9ea8554ff0a0fabdde87f02cbe
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|
