Image Scraper
Simple python module for scraping images from the web, created for AI development.
Features
- scrape images from google.com and duckduckgo.com
- search duplicated and eliminate them.
- allow to create complex databases from the engine top search of supplied keyword.
- use tor network with firefox for scraping. (optional)
Basic Usage
>> imageCrawler.py -k cats dogs
>> Select by number the queries to ignore:
>> ( 0 ) cats
>> ( 1 ) cats with hats
>> 1
>> Start with cats download 4000 at engines\cats
>> 100%
>> Select by number the queries to ignore:
>> ( 0 ) dogs
>> ( 1 ) dogs with hats
>> 1
>> Start with dogs download 4000 at engines\dogs
>> 100%
>> Searching duplicated...
>> END
Results:
\engines
\cats
\ keys.json
\ +4000 images files
\dogs
\ keys.json
\ +4000 images files
Installing
(1) Install.
- Firefox
- TorBrowser (OPTIONAL).
(2) Download and add to path.
geckodriver combability check
(3) Run this command.
pip install engineCrawler
1 maintainer
Metadata
1 maintainer
Release files for engineCrawler 1.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| engineCrawler-1.3.tar.gz | 8.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| engineCrawler-1.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 21.6 kB
Release files / engineCrawler-1.3.tar.gz
| Download URL | engineCrawler-1.3.tar.gz |
|---|---|
| Size | 8.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5d97ff9e34b4fc0a9d0db1518095471213a8c33b347a49d4d8431ad3620a277b
|
|
BLAKE2b-256 checksum How to use checksums |
5f7d9de623c0f63eabacdfbce760caf84d48de2d378ba6c315736212d5de9031
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.7.9
|
Release files / engineCrawler-1.3-py3-none-any.whl
| Download URL | engineCrawler-1.3-py3-none-any.whl |
|---|---|
| Size | 12.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
691efef832d9f79ffa54d0bd13a7b1eecbe6c23a91b3689e1fcf6637c886ad93
|
|
BLAKE2b-256 checksum How to use checksums |
fc39392997f585d90e88b477bd9c7b5521a6fe65473badcfdab814ba55dea483
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.7.9
|
