Skip to main content

A simple image scraper to download all images from a given url

Project description

A high performance, easy to use, multithreaded command line tool which downloads images from the given webpage.

Build Status

Version

Downloads

Build Status

Latest Version

PyPi downloads

Demo

Click here to see it in action!

Download

You can also download using pip:

$ pip install ImageScraper

Dependencies

Note that ImageScraper depends on lxml, requests, setproctitle, and future. It also depends on pyThreadpool which can be downloaded and installed from here temporarily. If you run into problems in the compilation of lxml through pip, install the libxml2-dev and libxslt-dev packages on your system.

Usage

$ image-scraper [OPTIONS] URL

You can also use it in your Python scripts.

import image_scraper
image_scraper.scrape_images(URL)

Options

-h, --help                      Print help
-m, --max-images <number>       Maximum number images to be scraped
-s, --save-dir  <path>          Name of the folder to save the images
-g, --injected                  Scrape injected images
--formats [ [FORMATS ..]]       Specify the formats of images to be scraped
--max-filesize  <size>          Limit on size of image in bytes (default: 100000000)
--dump-urls                     Print the URLs of the images
--scrape-reverse                Scrape the images in reverse order
--proxy-urls            Use the specified HTTP/HTTPS proxy

If you downloaded the tar:

Extract the contents of the tar file.

$ cd ImageScraper/
$ python setup.py install
$ image-scraper --max-images 10 [url to scrape]

Examples

Scrape all images

$ image-scraper  ananth.co.in/test.html

Scrape at max 2 images

$ image-scraper -m 2 ananth.co.in/test.html

Scrape only gifs and download to folder ./mygifs

$ image-scraper -s mygifs ananth.co.in/test.html --formats gif

NOTE:

By default, a new folder called “images_” will be created in the working directory, containing all the downloaded images.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ImageScraper-2.0.7.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

ImageScraper-2.0.7-py2.py3-none-any.whl (10.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file ImageScraper-2.0.7.tar.gz.

File metadata

File hashes

Hashes for ImageScraper-2.0.7.tar.gz
Algorithm Hash digest
SHA256 8cd50d3d601a71091fc6af3f37a4962091e7f2c0753a1ea530c090cc87523543
MD5 5064356dd451ef6dc5375c5e0f71943b
BLAKE2b-256 5716ae81054a1fc319bc7d2725288d48fd9d0aa4612e704f9943e837699409b8

See more details on using hashes here.

File details

Details for the file ImageScraper-2.0.7-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for ImageScraper-2.0.7-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 90c8bcf12b0a975bf52c64cd186a34c047fdbbd7b97d576dfc5b87e111cf719a
MD5 949b58891450e3797528fd8957c92cee
BLAKE2b-256 434be1e2af3b0892cf55fe4db06ce16e6d1d41c6bb95ae208b52109316da948c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page