Skip to main content

Download files parallely from a list of URLs in a file

Project description

Parldl

Download files parallely from a list of URLs in a file.

Installation

Recommended
pipx install parldl

(To install pipx click here)

or
pip install parldl

Or upgrade by:

pipx upgrade parldl
or
pip install --upgrade parldl

Usage

  1. Create a file containing a list of URLs, one URL per line.
  2. Run parldl with the path to the file as an argument.
  3. parldl will download the images and save them in a directory provided or in "pardl-downloads" by default.

Example

parldl image_urls.txt output_dir
parldl image_urls.txt
Usage: parldl [OPTIONS] [URL_FILE] [OUTPUT_DIR]

  Download files parallely from a list of URLs in a file

Options:
  -i, --input PATH            File containing newline-separated URLs
  -o, --output PATH           Output directory path
  -m, --max-attempts INTEGER  Maximum number of download attempts
  -p, --parallel INTEGER      Maximum number of parallel downloads
  --help                      Show this message and exit.

Install from source

Poetry is required. For installation click here.

Download the source and install the dependencies by running:

git clone https://github.com/aqdasak/parldl.git
cd parldl
poetry install

Run

In the source folder containing pyproject.toml

poetry shell

then cd into the folder containing url file and execute:

parldl <url_file> <output_dir>

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parldl-0.1.0.tar.gz (4.6 kB view hashes)

Uploaded Source

Built Distribution

parldl-0.1.0-py3-none-any.whl (4.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page