Skip to main content

A simple lightweight library to download images (and other files)

Project description

Python Image Fetcher

A simple lightweight library to download images (and other files)

Install

With Python 3.5+ run:

pip install image-fetcher

Key features

  • Speed: By using multi-threading, more images can be downloaded per second
  • No download duplication: To avoid unnecessary downloads
  • Progress bar: To track how your download is getting on

Usage

The simplest usage involves passing a list of URL's and the folder you want the images to be saved to:

from image_fetcher import multi_thread_image_download

multi_thread_image_download(
    ["https://benaandrew.github.io/images/sentiment.jpg","https://benaandrew.github.io/images/dog.jpg"],
    "images",
)

If you have your URL's saved in a text file you can instead give the path to that file

multi_thread_image_download(
    "urls.txt",
    "images",
)

Additional arguments

  • max_fetching_threads (int): Sets the maximum number of concurrent image downloads
    • Increasing this increases download throughput but also uses more processing power and can cause errors when set too high
    • By default is set the number of cpu cores x 5
  • download_timeout (int): Seconds before a download is abandoned
    • Increasing this means more time will be allowed per download. If every download is important you should set this high
    • If set to None, download will only timeout if the connection does so
    • The default is 5 seconds
  • verbose (bool): Whether to show progress bar
    • On by default

You can pass these like so:

multi_thread_image_download(
    "urls.txt",
    "images",
    max_fetching_threads=5,
    download_timeout=10,
    verbose=False
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for image-fetcher, version 2.0.1
Filename, size File type Python version Upload date Hashes
Filename, size image_fetcher-2.0.1.tar.gz (4.9 kB) File type Source Python version None Upload date Hashes View
Filename, size image_fetcher-2.0.1-py3-none-any.whl (6.2 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page