Skip to main content
Join the official Python Developers Survey 2018 and win valuable prizes: Start the survey!

A simple image scraper to download all images from a given url

Project description

A high performance, easy to use, multithreaded command line tool which downloads images from the given webpage.

Build Status Version Downloads
Build Status Latest Version PyPi downloads

Demo

Click here to see it in action!

Download

You can also download using pip:

$ pip install ImageScraper

Dependencies

Note that ImageScraper depends on lxml, requests, setproctitle, and future. It also depends on pyThreadpool which can be downloaded and installed from here temporarily. If you run into problems in the compilation of lxml through pip, install the libxml2-dev and libxslt-dev packages on your system.

Usage

$ image-scraper [OPTIONS] URL

You can also use it in your Python scripts.

import image_scraper
image_scraper.scrape_images(URL)

Options

-h, --help                      Print help
-m, --max-images <number>       Maximum number images to be scraped
-s, --save-dir  <path>          Name of the folder to save the images
-g, --injected                  Scrape injected images
--formats [ [FORMATS ..]]       Specify the formats of images to be scraped
--max-filesize  <size>          Limit on size of image in bytes (default: 100000000)
--dump-urls                     Print the URLs of the images
--scrape-reverse                Scrape the images in reverse order
--proxy-urls            Use the specified HTTP/HTTPS proxy

If you downloaded the tar:

Extract the contents of the tar file.

$ cd ImageScraper/
$ python setup.py install
$ image-scraper --max-images 10 [url to scrape]

Examples

Scrape all images

$ image-scraper  ananth.co.in/test.html

Scrape at max 2 images

$ image-scraper -m 2 ananth.co.in/test.html

Scrape only gifs and download to folder ./mygifs

$ image-scraper -s mygifs ananth.co.in/test.html --formats gif

NOTE:

By default, a new folder called “images_” will be created in the working directory, containing all the downloaded images.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
ImageScraper-2.0.7-py2.py3-none-any.whl (10.0 kB) Copy SHA256 hash SHA256 Wheel 2.7 May 5, 2015
ImageScraper-2.0.7.tar.gz (8.6 kB) Copy SHA256 hash SHA256 Source None May 5, 2015

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page