A simple image scraper to download all images from a given url
Project description
A high performance, easy to use, multithreaded command line tool which downloads images from the given webpage.
Build Status |
Version |
Downloads |
---|---|---|
Demo
Click here to see it in action!
Download
pip install (recommended):
You can also download using pip:
$ pip install ImageScraper
Dependencies
Note that ImageScraper depends on lxml, requests, setproctitle, and future. It also depends on pyThreadpool which can be downloaded and installed from here temporarily. If you run into problems in the compilation of lxml through pip, install the libxml2-dev and libxslt-dev packages on your system.
Usage
$ image-scraper [OPTIONS] URL
You can also use it in your Python scripts.
import image_scraper
image_scraper.scrape_images(URL)
Options
-h, --help Print help
-m, --max-images <number> Maximum number images to be scraped
-s, --save-dir <path> Name of the folder to save the images
-g, --injected Scrape injected images
--formats [ [FORMATS ..]] Specify the formats of images to be scraped
--max-filesize <size> Limit on size of image in bytes (default: 100000000)
--dump-urls Print the URLs of the images
--scrape-reverse Scrape the images in reverse order
--proxy-urls Use the specified HTTP/HTTPS proxy
If you downloaded the tar:
Extract the contents of the tar file.
$ cd ImageScraper/
$ python setup.py install
$ image-scraper --max-images 10 [url to scrape]
Examples
Scrape all images
$ image-scraper ananth.co.in/test.html
Scrape at max 2 images
$ image-scraper -m 2 ananth.co.in/test.html
Scrape only gifs and download to folder ./mygifs
$ image-scraper -s mygifs ananth.co.in/test.html --formats gif
NOTE:
By default, a new folder called “images_” will be created in the working directory, containing all the downloaded images.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file ImageScraper-2.0.7.tar.gz
.
File metadata
- Download URL: ImageScraper-2.0.7.tar.gz
- Upload date:
- Size: 8.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8cd50d3d601a71091fc6af3f37a4962091e7f2c0753a1ea530c090cc87523543 |
|
MD5 | 5064356dd451ef6dc5375c5e0f71943b |
|
BLAKE2b-256 | 5716ae81054a1fc319bc7d2725288d48fd9d0aa4612e704f9943e837699409b8 |
File details
Details for the file ImageScraper-2.0.7-py2.py3-none-any.whl
.
File metadata
- Download URL: ImageScraper-2.0.7-py2.py3-none-any.whl
- Upload date:
- Size: 10.0 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 90c8bcf12b0a975bf52c64cd186a34c047fdbbd7b97d576dfc5b87e111cf719a |
|
MD5 | 949b58891450e3797528fd8957c92cee |
|
BLAKE2b-256 | 434be1e2af3b0892cf55fe4db06ce16e6d1d41c6bb95ae208b52109316da948c |