Skip to main content

Python package for Automating Images building dataset for ML/DL Workflow using Tkinter GUI

Project description

Automate-Images + Videos-download

Introduction :

Data collection is one of the important steps in Data analysis , Machine learning and Deep learning. It is the process of gathering information of our interest, in our case it's the images of any type we want to gather. Without data, we can't model our problem and do analysis of it.

Objective :

👉 Automate the collection and building of images using Google API's for search and videos using Youtube API's.
👉 Option to send mails to anyone containing collected datasets as attachment.

Getting credentials for Google API and Youtube API:

For Google image API For Youtube API

Getting Started Locally :

  • After getting the credentials , we can now run the script for automation.
  • Firstly download all the files on your system using cmd (terminal) or git bash :
    git clone https://github.com/souravs17031999/AUTOMATE-DATA-PIPELINE

With Tkinter GUI :

For IMAGES :

  • Move to the directory where script is downloaded.
  • Now run the script in following way :
    python data_image_automation.py
    and arguments can be passed from interactive GUI.

For VIDEOS :

  • Move to the directory where script is downloaded.
  • Now run the script in following way :
    python data_video_automation.py
    and arguments can be passed from interactive GUI.
    Note : Two important args :

Client secrets file path: Give absolute path.
Chrome driver path : Give absolute path with .exe extension.

Output :

Some samples of images : output
output
output
output
output

Limitations and Scope for future work:

There are few limitations :

  • Currently Google and Youtube allows 100 requests in one API call and so the script is able to download in total 100API's in one go but this behaviour can be changed from the script by calling it multiple times after tweaking some parameters which controls the after and before id's of returned images and videos and can be checked in their API documentation.
  • [For Images] Considering big file sizes for sending as mails, i have resized , gray-scaled and then zipped the files and upload as attachment.
    This behaviour can be changed from the script by disabling some of the functions passing a optional parameter.
  • [For videos] Considering big file sizes for sending as mails, i have compressed the file sizes and reduced the duration of videos.
    This behaviour can be easily manipulated in the script itself.
  • Also, mail can be only sent for GMAIL users as of now, this can also be changed by manipulating the Ports of all email servers and controlling their behaviours in the script.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for images-automate-python-souravdlboy, version 1.0
Filename, size File type Python version Upload date Hashes
Filename, size images_automate_python_souravdlboy-1.0-py3-none-any.whl (3.6 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size images-automate-python-souravdlboy-1.0.tar.gz (2.7 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page