Python project fetching a webpage
Project description
webloader
Python utility to fetch a webpage and save it to disk
Project Setup for Development
source setup.sh
Command to execute
python3 fetch.py <url 1> <url 2> <url N> --metadata --archive_assets
sample
python3 fetch.py --metadata --archive_assets https://www.google.com/
Note:
--metadata : To print metadata of webpage
--archive_assets : To save assets to a directory named after url
Trigger tests:
python3 -m pytest
Uploaded On:
https://pypi.org/project/webloader/
To use this as a python library
Run command: pip intall webloader
Run command: fetch <url 1> <url 2> <url N> --metadata --archive_assets
Sample command: fetch --metadata --archive_assets https://www.google.com/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
webloader-0.1.0.tar.gz
(4.4 kB
view hashes)
Built Distribution
Close
Hashes for webloader-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e2e225950737c187e122582a5bd2c8bd9687d7f46e5a382fed8126e44631a45 |
|
MD5 | cc4ec81a92deb95a35a35c640e73a8dc |
|
BLAKE2b-256 | f0cc58ba3948715c8ec2564f682ff49ecf383098285e98fa0714f78b29a9a055 |