imagebot
A web bot to scrape images from websites.
Features
Supported platform: Linux (+Gnome) / Python 2.x.
Uses scrapy web crawling framework.
Maintains a database of all downloaded images to avoid duplicate downloads.
Optionally, it can scrape only under a particular url, e.g. scraping “http://website.com/albums/new” with this option will only download from new album.
You can specify minimum image size to be downloaded.
Scrapes through javascript popup links.
Live monitor window for displaying images as they are scraped.
Usage
Scrape images from http://website.com:
imagebot http://website.com
Scrape images from http://website.com while allowing images from a cdn such as amazonaws.com (add multiple domains with comma separated list):
imagebot http://website.com -d amazonaws.com
Specify minimum size of image to be downloaded (width x height):
imagebot http://website.com -s 300x300
Stay under http://website.com/albums/new:
imagebot http://website.com/albums/new -u http://website.com/albums/new
Launch monitor windows for live images:
imagebot http://website.com -m
Set user-agent:
imagebot http://website.com -a "my_imagebot(http://mysite.com)"
For more options, get help:
imagebot -h
Dependencies
python-gi (Python GObject Introspection API)
On Ubuntu:
apt-get install python-gi
scrapy (a powerful web crawling framework)
It will be automatically installed by pip.
Pillow (Python Imaging Library)
It will be automatically installed by pip.
Download
Metadata
Release files for imagebot 1.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| imagebot-1.0.2.tar.gz | 11.9 kB | Without provenance | Details for imagebot-1.0.2.tar.gz |
Release files / imagebot-1.0.2.tar.gz
| Download URL | imagebot-1.0.2.tar.gz |
|---|---|
| Size | 11.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ea091b734269c896967a159a7de48c8aee8d351d2ac3ab335dc9cd42aa548551
|
|
BLAKE2b-256 checksum How to use checksums |
c80355a8b1cd1832cc992755b412b0d4ec2d8432922422a1bb2694c660fcbd0c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Security for imagebot 1.0.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.