Skip to main content

Download files parallely from a list of URLs in a file

Project description

Parldl

Download files parallely from a list of URLs in a file.

Installation

Recommended
pipx install parldl

(To install pipx click here)

or
pip install parldl

Or upgrade by:

pipx upgrade parldl
or
pip install --upgrade parldl

Usage

  1. Create a file containing a list of URLs, one URL per line.
  2. Run parldl with the path to the file as an argument.
  3. parldl will download the images and save them in a directory provided or in "pardl-downloads" by default.

Example

parldl image_urls.txt output_dir
parldl image_urls.txt
Usage: parldl [OPTIONS] [URL_FILE] [OUTPUT_DIR]

  Download files parallely from a list of URLs in a file

Options:
  -i, --input PATH            File containing newline-separated URLs
  -o, --output PATH           Output directory path
  -m, --max-attempts INTEGER  Maximum number of download attempts
  -p, --parallel INTEGER      Maximum number of parallel downloads
  --help                      Show this message and exit.

Install from source

Poetry is required. For installation click here.

Download the source and install the dependencies by running:

git clone https://github.com/aqdasak/parldl.git
cd parldl
poetry install

Run

In the source folder containing pyproject.toml

poetry shell

then cd into the folder containing url file and execute:

parldl <url_file> <output_dir>

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parldl-0.2.0.tar.gz (4.6 kB view details)

Uploaded Source

Built Distribution

parldl-0.2.0-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file parldl-0.2.0.tar.gz.

File metadata

  • Download URL: parldl-0.2.0.tar.gz
  • Upload date:
  • Size: 4.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.0 CPython/3.10.6 Linux/6.9.3-76060903-generic

File hashes

Hashes for parldl-0.2.0.tar.gz
Algorithm Hash digest
SHA256 a93e5faecc1eb89f5956c35c4bf5b3d6f013b0a47c0c9e281301397479fbf95b
MD5 7641fd9b8bda28fb7e51e4331f3efbb6
BLAKE2b-256 704eba41ad67234cc57edaf8fb6082380ff2218c6492c67e0a299e35b10a3903

See more details on using hashes here.

File details

Details for the file parldl-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: parldl-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 4.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.0 CPython/3.10.6 Linux/6.9.3-76060903-generic

File hashes

Hashes for parldl-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4b6453234215c6a25a70635ea1776e56d5304fd01577b3b1d02584f18198ec0c
MD5 2b83e0aec8597e35655ac8014eae76a3
BLAKE2b-256 be9797bf497752170c2e80522d7daccbe75ea29bb06959c4e4e3a8bc0df90535

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page