Skip to main content

url2text

A light weight library that takes in a url and extracts any readable text in it.

Accepting any and all PRs!

Installation

pip install url2text

Pre-requisites

  1. url2text uses selenium with the driver scope currently limited to chrome only. Please ensure that chromedriver is properly configured. Use this link for installation instructions.

Usage

  1. Import and initialize ContentFinder
from url2text import ContentFinder
cf = ContentFinder
  1. Scrape a url
# scrape a url
cs.scrape_url(url="your_url_here")

# print the article
cs.print_article(url="your_url_here")

# all urls passed will be stored in the class instance.
# use the flush_data method to free memory
cs.flush_data()

Enjoy!

Metadata

Release files for urltotext 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for urltotext 0.1.0
File Size Uploaded
urltotext-0.1.0.tar.gz 15.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for urltotext 0.1.0
File Interpreter ABI Platform
urltotext-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 31.5 kB

Release files / urltotext-0.1.0.tar.gz

Download URL urltotext-0.1.0.tar.gz
Size 15.6 kB
Tags Source
SHA-256 checksum
How to use checksums
cd2310b175a77faab096dc41799e179432dbc970d382df0656cb484ffd8c1fea
BLAKE2b-256 checksum
How to use checksums
e610b9c337d18fe789576657ae59c83eaa7f54b7f06cacbabde47e8d6d3414f7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.11.5

Release files / urltotext-0.1.0-py3-none-any.whl

Download URL urltotext-0.1.0-py3-none-any.whl
Size 15.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e032fe51d46f0c20d3c5357a528a34cc2f3ab48db168dd963c9c4b8fe034a7f6
BLAKE2b-256 checksum
How to use checksums
5dad7321b1721ca90e00e8f41df896de29c7d6129c01dd692de507de752fcaa4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.11.5

Release history Release notifications | RSS feed

0.3.0

2 release files

0.2.0

2 release files

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page