urltotext
A light weight library that takes in a url and extracts any readable text in it.
Accepting any and all PRs!
Installation
pip install urltotext
Pre-requisites
urltotextusesseleniumwith the driver scope currently limited tochromeonly. Please ensure that chromedriver is properly configured. Use this link for installation instructions.
Usage
- Import and initialize ContentFinder
from urltotext import ContentFinder
cf = ContentFinder()
- Scrape a url
# scrape a url
cs.scrape_url(url="your_url_here")
# print the article
cs.print_article(url="your_url_here")
# all urls passed will be stored in the class instance.
# use the flush_data method to free memory
cs.flush_data()
Enjoy!
1 maintainer
Release files for urltotext 0.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| urltotext-0.3.0.tar.gz | 15.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| urltotext-0.3.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 31.5 kB
Release files / urltotext-0.3.0.tar.gz
| Download URL | urltotext-0.3.0.tar.gz |
|---|---|
| Size | 15.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
86a9204af6c38c734a4eb0ee34882477d13f9635eceae6dfc716aff68a638b7c
|
|
BLAKE2b-256 checksum How to use checksums |
a304923ca3bbd26f493555bafe7ee6227d86c962ef4f8ef04c60de02f5cc029f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|
Release files / urltotext-0.3.0-py3-none-any.whl
| Download URL | urltotext-0.3.0-py3-none-any.whl |
|---|---|
| Size | 15.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
598b47b8e71a4ac07618aec5af09f6916340b174dfb57c5d26247c45fbe9765c
|
|
BLAKE2b-256 checksum How to use checksums |
9eb5a9e7a8540124e27c1a8206a2eeecc63933c355c40b34dea536c4a6ae5a1d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.11.5
|
