Skip to main content

Python project fetching a webpage

Project description

build codecov

webloader

Python utility to fetch a webpage and save it to disk

Project Setup for Development

  • source setup.sh

Command to execute

python3 fetch.py <url 1> <url 2> <url N> --metadata --archive_assets

sample

python3 fetch.py --metadata --archive_assets https://www.google.com/

Note:
--metadata : To print metadata of webpage
--archive_assets : To save assets to a directory named after url

Trigger tests:

python3 -m pytest

Uploaded On:

https://pypi.org/project/webloader/

To use this as a python library

Run command: pip intall webloader
Run command: fetch <url 1> <url 2> <url N> --metadata --archive_assets
Sample command: fetch --metadata --archive_assets https://www.google.com/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

webloader-0.1.0.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

webloader-0.1.0-py3-none-any.whl (5.9 kB view details)

Uploaded Python 3

File details

Details for the file webloader-0.1.0.tar.gz.

File metadata

  • Download URL: webloader-0.1.0.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.11.2

File hashes

Hashes for webloader-0.1.0.tar.gz
Algorithm Hash digest
SHA256 8b4f5c1f16c473198b0d817733fc2898b4d52a075e96bf75cb6a5bab2d84bc53
MD5 af0a8d8f59efe78acaf35a518d1c56b8
BLAKE2b-256 abb5720a8090c84144b7887f72dfec618584e2152ed071784852e19bdab32b2e

See more details on using hashes here.

File details

Details for the file webloader-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: webloader-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 5.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.11.2

File hashes

Hashes for webloader-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3e2e225950737c187e122582a5bd2c8bd9687d7f46e5a382fed8126e44631a45
MD5 cc4ec81a92deb95a35a35c640e73a8dc
BLAKE2b-256 f0cc58ba3948715c8ec2564f682ff49ecf383098285e98fa0714f78b29a9a055

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page