A simple lightweight library to download images (and other files)
Project description
Python Image Fetcher
A simple lightweight library to download images (and other files)
Install
With Python 3.5+ run:
pip install image-fetcher
Key features
- Speed: By using multi-threading, more images can be downloaded per second
- No download duplication: To avoid unnecessary downloads
- Progress bar: To track how your download is getting on
Usage
The simplest usage involves passing a list of URL's and the folder you want the images to be saved to:
from image_fetcher import multi_thread_image_download
multi_thread_image_download(
["https://benaandrew.github.io/images/sentiment.jpg","https://benaandrew.github.io/images/dog.jpg"],
"images",
)
If you have your URL's saved in a text file you can instead give the path to that file
multi_thread_image_download(
"urls.txt",
"images",
)
Additional arguments
- max_fetching_threads (int): Sets the maximum number of concurrent image downloads
- Increasing this increases download throughput but also uses more processing power and can cause errors when set too high
- By default is set the number of cpu cores x 5
- download_timeout (int): Seconds before a download is abandoned
- Increasing this means more time will be allowed per download. If every download is important you should set this high
- If set to None, download will only timeout if the connection does so
- The default is 5 seconds
- verbose (bool): Whether to show progress bar
- On by default
You can pass these like so:
multi_thread_image_download(
"urls.txt",
"images",
max_fetching_threads=5,
download_timeout=10,
verbose=False
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
image_fetcher-2.0.1.tar.gz
(4.9 kB
view hashes)
Built Distribution
Close
Hashes for image_fetcher-2.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33a40dfcf68619881f744401a4723fa321da97b7bb7f66e442f9ae154089833e |
|
MD5 | 68c00134d64e53ec0566853e09f8bcc4 |
|
BLAKE2b-256 | b015b7d2a414c12010bf93ce96b62c7154e4b1864c76e78bc63b9e2601385e80 |