Skip to main content

imagebot

A web bot to scrape images from websites.

Features

  • Supported platform: Linux (+Gnome) / Python 2.x.

  • Uses scrapy web crawling framework.

  • Maintains a database of all downloaded images to avoid duplicate downloads.

  • Optionally, it can scrape only under a particular url, e.g. scraping “http://website.com/albums/new” with this option will only download from new album.

  • You can specify minimum image size to be downloaded.

  • Scrapes through javascript popup links.

  • Live monitor window for displaying images as they are scraped.

Usage

  1. Scrape images from http://website.com:

    imagebot http://website.com
  2. Scrape images from http://website.com while allowing images from a cdn such as amazonaws.com (add multiple domains with comma separated list):

    imagebot http://website.com -d amazonaws.com
  3. Specify minimum size of image to be downloaded (width x height):

    imagebot http://website.com -s 300x300
  4. Stay under http://website.com/albums/new:

    imagebot http://website.com/albums/new -u http://website.com/albums/new
  5. Launch monitor windows for live images:

    imagebot http://website.com -m
  6. Set user-agent:

    imagebot http://website.com -a "my_imagebot(http://mysite.com)"
  7. For more options, get help:

    imagebot -h

Dependencies

  1. python-gi (Python GObject Introspection API)

    On Ubuntu:

    apt-get install python-gi
  2. scrapy (a powerful web crawling framework)

    It will be automatically installed by pip.

  3. Pillow (Python Imaging Library)

    It will be automatically installed by pip.

Download

Metadata

Release files for imagebot 1.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for imagebot 1.0.2
File Size Uploaded Provenance Actions
imagebot-1.0.2.tar.gz 11.9 kB Without provenance Details for imagebot-1.0.2.tar.gz

Release files / imagebot-1.0.2.tar.gz

Download URL imagebot-1.0.2.tar.gz
Size 11.9 kB
Tags Source
SHA-256 checksum
How to use checksums
ea091b734269c896967a159a7de48c8aee8d351d2ac3ab335dc9cd42aa548551
BLAKE2b-256 checksum
How to use checksums
c80355a8b1cd1832cc992755b412b0d4ec2d8432922422a1bb2694c660fcbd0c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for imagebot 1.0.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page