Python project fetching a webpage
Project description
webloader
Python utility to fetch a webpage and save it to disk
Project Setup for Development
source setup.sh
Command to execute
python3 fetch.py <url 1> <url 2> <url N> --metadata --archive_assets
sample
python3 fetch.py --metadata --archive_assets https://www.google.com/
Note:
--metadata : To print metadata of webpage
--archive_assets : To save assets to a directory named after url
Trigger tests:
python3 -m pytest
Uploaded On:
https://pypi.org/project/webloader/
To use this as a python library
Run command: pip intall webloader
Run command: fetch <url 1> <url 2> <url N> --metadata --archive_assets
Sample command: fetch --metadata --archive_assets https://www.google.com/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file webloader-0.1.0.tar.gz
.
File metadata
- Download URL: webloader-0.1.0.tar.gz
- Upload date:
- Size: 4.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b4f5c1f16c473198b0d817733fc2898b4d52a075e96bf75cb6a5bab2d84bc53 |
|
MD5 | af0a8d8f59efe78acaf35a518d1c56b8 |
|
BLAKE2b-256 | abb5720a8090c84144b7887f72dfec618584e2152ed071784852e19bdab32b2e |
File details
Details for the file webloader-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: webloader-0.1.0-py3-none-any.whl
- Upload date:
- Size: 5.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e2e225950737c187e122582a5bd2c8bd9687d7f46e5a382fed8126e44631a45 |
|
MD5 | cc4ec81a92deb95a35a35c640e73a8dc |
|
BLAKE2b-256 | f0cc58ba3948715c8ec2564f682ff49ecf383098285e98fa0714f78b29a9a055 |