Image scraper for DuckDuckGo for creating deep learning datasets
Project description
jmd_imagescraper
An image scraping library for creating deep learning datasets.
This library is for creating deep learning datasets.
It uses DuckDuckGo for the image scraping as they return nice big images and have some rather nice parameters to make your life easier, for example we can filter the searches to only return square images which are photos.
jmd_imagescraper.core
contains the main scraping/downloading functionality.
jmd_imagescraper.imagecleaner
contains an image cleaner you can use from within your notebook to clean up the results and delete anything unsuitable.
Install
pip install jmd_imagescraper
How to use
from jmd_imagescraper.core import * # dont't worry, it's designed to work with import *
from pathlib import Path
root = Path().cwd()/"images"
duckduckgo_search(root, "Cats", "cute kittens", max_results=20)
from jmd_imagescraper.imagecleaner import *
display_image_cleaner(root)
Docs
If you're reading this on pypi.org you can find the docs at https://joedockrill.github.io/jmd_imagescraper/
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for jmd_imagescraper-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e680921aec12c734927f6d62dbb8237915a1482273fca558cd96523db50c162d |
|
MD5 | 0b09f5091a5fe75d6b741267181954d7 |
|
BLAKE2b-256 | e1be05652595fe9f65d72a85f32cdae4a902d3e5e53e9e5b1676b0220ef32034 |