url2text
A light weight library that takes in a url and extracts any readable text in it.
Accepting any and all PRs!
Installation
pip install url2text
Pre-requisites
url2textusesseleniumwith the driver scope currently limited tochromeonly. Please ensure that chromedriver is properly configured. Use this link for installation instructions.
Usage
- Import and initialize ContentFinder
from url2text import ContentFinder
cf = ContentFinder
- Scrape a url
# scrape a url
cs.scrape_url(url="your_url_here")
# print the article
cs.print_article(url="your_url_here")
# all urls passed will be stored in the class instance.
# use the flush_data method to free memory
cs.flush_data()
Enjoy!
Metadata
Release files for urltotext 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| urltotext-0.1.0.tar.gz | 15.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| urltotext-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 31.5 kB
Release files / urltotext-0.1.0.tar.gz
| Download URL | urltotext-0.1.0.tar.gz |
|---|---|
| Size | 15.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
cd2310b175a77faab096dc41799e179432dbc970d382df0656cb484ffd8c1fea
|
|
BLAKE2b-256 checksum How to use checksums |
e610b9c337d18fe789576657ae59c83eaa7f54b7f06cacbabde47e8d6d3414f7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|
Release files / urltotext-0.1.0-py3-none-any.whl
| Download URL | urltotext-0.1.0-py3-none-any.whl |
|---|---|
| Size | 15.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e032fe51d46f0c20d3c5357a528a34cc2f3ab48db168dd963c9c4b8fe034a7f6
|
|
BLAKE2b-256 checksum How to use checksums |
5dad7321b1721ca90e00e8f41df896de29c7d6129c01dd692de507de752fcaa4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|