Skip to main content

Package for collecting data and transforming to dataset

Project description

idatagate

idatagate is a CLI tool designed for managing and processing hand image datasets, as well as uploading files to Google Storage. It allows you to collect images, transform them into datasets, and manage files in Google Drive storage efficiently.

Table Of Contents

Features

  • Collect hand images with real-time landmark detection for multiple classes.
  • Upload files to Google Storage.
  • Download files or list files from Google Storage.

Installation

To install idatagate, run:

pipx install idatagate

Usage

Collecting Hand Images

To collect images, run:

idatagate collect --data-dir /path/to/save/images --classes-number 26 --samples-number 100

The command will take images for 26 different classes (such as the alphabet in sign language) and store them in the specified directory. Each class will have by default 100 images collected using landmark detection. The collection will continue until all images are gathered for each class. The image collection uses real-time landmark detection to capture high-quality images. For reference, the classes are aligned with the alphabet as demonstrated in this example image:

img

Example Command

idatagate collect --data-dir ./images --classes-number 26 --samples-number 100

This command will continuously capture images for 26 classes (each corresponding to a letter of the alphabet) until 100 samples per class are collected.

Uploading Files

To upload a zip file to Google Storage, use:

idatagate upload --key <API_KEY>

Make sure the key is already set before running the upload command. If the key is not set, use the idatagate set-key command as described earlier.

Listing Files

To list files in Google Storage, use:

idatagate list

Downloading Files

To download a file from Google Storage, you can specify a file ID:

idatagate download --file-id <FILE_ID>

Or download all files:

idatagate download

Instruction

Firsly collect the data with

idatagate collect

then upload files to server:

idatagate upload

Caching the Encryption Key

The first time you run the set-key command, the key is securely stored using a credentials management system. You don't need to provide the key again unless you wish to change it.

bash

Contributing

Feel free to open issues or contribute by submitting pull requests.

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

idatagate-0.0.2.tar.gz (55.8 kB view details)

Uploaded Source

Built Distribution

idatagate-0.0.2-py3-none-any.whl (55.5 kB view details)

Uploaded Python 3

File details

Details for the file idatagate-0.0.2.tar.gz.

File metadata

  • Download URL: idatagate-0.0.2.tar.gz
  • Upload date:
  • Size: 55.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.9 Linux/6.5.0-1025-azure

File hashes

Hashes for idatagate-0.0.2.tar.gz
Algorithm Hash digest
SHA256 cbe8c72ac10a4702d00d8367e41610cc6ae6c00f31f5c7b075e028e6a3aa6ffe
MD5 53c261a711af1347cfd5494ff7181c0f
BLAKE2b-256 464a86b8280cc090e610ee5f33b962b3acd6418e33e1256e29c24e8abf9fc82d

See more details on using hashes here.

File details

Details for the file idatagate-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: idatagate-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 55.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.9 Linux/6.5.0-1025-azure

File hashes

Hashes for idatagate-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 c75b1711685de9380e11d9a89e5f819f78ba39e80a09114e8aa0f4c80555967f
MD5 d29384d1de33fd0cd8d304ed4d2c5d2d
BLAKE2b-256 0867caaed1f6e866ef452bb58f9db702f99bd92085d79f600355f67733bec5a0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page