grepurl

grepurl is a command line tool that extracts URLs from a website (or a local HTML file).

Usage

grepurl http://example.com/ # extract all URLs from links and images
grepurl -a http://example.com/foo.htm # only extract from <a> tags (i.e. links)
grepurl -i http://example.com/bar.htm # only extract from <img> tags (i.e. images)
grepurl -r "\.py$" http://example.com/ # only extract links that end in '.py'
grepurl -r "\.zip$" -d http://example.com/ # download all zip files
grepurl -r "\.zip$" -d -o download_dir http://example.com/ # download all zip files into download_dir

Installation using pip

pip install grepurl

Installation from repository

git clone https://github.com/arne-cl/grepurl
cd grepurl
pip install -e .

License

GPLv2 or later.

Authors

Gerome Fournier (original author). His implementation is only available via the Internet Archive.

Arne Neumann (added -l option for local files, minor changes).

GPT-4 (rewrote the script for Python 3 compatibility).

Metadata

Release files for grepurl 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for grepurl 0.2.0
File	Size	Uploaded	Provenance	Actions
grepurl-0.2.0.tar.gz	3.1 kB	Apr 5, 2024	Without provenance	Details for grepurl-0.2.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for grepurl 0.2.0
File	Interpreter	ABI	Platform	Actions Reset
grepurl-0.2.0-py3-none-any.whl 3.6 kB Apr 5, 2024 Without provenance	Python 3	none	any	Details for grepurl-0.2.0-py3-none-any.whl

Total release size: 6.7 kB

Release files / grepurl-0.2.0.tar.gz

Download URL	grepurl-0.2.0.tar.gz
Size	3.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`91249b7020229b5a975b07b7316a2f64e54ed1d3ba367efb532f1d6ba39b5244`
BLAKE2b-256 checksum How to use checksums	`e8cc98dc4a7db995a3c5dbfb82358c8c727435796e0c2033ab7e860ea060e806`
Upload date	Apr 5, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.8.0 pkginfo/1.10.0 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.18 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.15`

Release files / grepurl-0.2.0-py3-none-any.whl

Download URL	grepurl-0.2.0-py3-none-any.whl
Size	3.6 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`1c9e83a313f7b7b6639f8cf15654d840999ae6fc2baba728cb914c5687107327`
BLAKE2b-256 checksum How to use checksums	`95993e2acca72e817ef4c501e83933c6fce31c332a8501714dbc99e26a2fe5d2`
Upload date	Apr 5, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.8.0 pkginfo/1.10.0 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.18 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.15`

Security for grepurl 0.2.0

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.