Package for collecting data and transforming to dataset
Project description
idatagate
idatagate
is a CLI tool designed for managing and processing hand image datasets, as well as uploading files to Google Storage. It allows you to collect images, transform them into datasets, and manage files in Google Drive storage efficiently.
Table Of Contents
Features
- Collect hand images with real-time landmark detection for multiple classes.
- Upload files to Google Storage.
- Download files or list files from Google Storage.
Installation
To install idatagate
, run:
pipx install idatagate
Usage
Collecting Hand Images
To collect images, run:
idatagate collect --data-dir /path/to/save/images --classes-number 26 --samples-number 100
The command will take images for 26 different classes (such as the alphabet in sign language) and store them in the specified directory. Each class will have by default 100 images collected using landmark detection. The collection will continue until all images are gathered for each class. The image collection uses real-time landmark detection to capture high-quality images. For reference, the classes are aligned with the alphabet as demonstrated in this example image:
Example Command
idatagate collect --data-dir ./images --classes-number 26 --samples-number 100
This command will continuously capture images for 26 classes (each corresponding to a letter of the alphabet) until 100 samples per class are collected.
Uploading Files
To upload a zip file to Google Storage, use:
idatagate upload --key <API_KEY>
Make sure the key is already set before running the upload command. If the key is not set, use the idatagate set-key command as described earlier.
Listing Files
To list files in Google Storage, use:
idatagate list
Downloading Files
To download a file from Google Storage, you can specify a file ID:
idatagate download --file-id <FILE_ID>
Or download all files:
idatagate download
Instruction
Firsly collect the data with
idatagate collect
then upload files to server:
idatagate upload
Caching the Encryption Key
The first time you run the set-key command, the key is securely stored using a credentials management system. You don't need to provide the key again unless you wish to change it.
bash
Contributing
Feel free to open issues or contribute by submitting pull requests.
License
This project is licensed under the MIT License.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file idatagate-0.0.2.tar.gz
.
File metadata
- Download URL: idatagate-0.0.2.tar.gz
- Upload date:
- Size: 55.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.11.9 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cbe8c72ac10a4702d00d8367e41610cc6ae6c00f31f5c7b075e028e6a3aa6ffe |
|
MD5 | 53c261a711af1347cfd5494ff7181c0f |
|
BLAKE2b-256 | 464a86b8280cc090e610ee5f33b962b3acd6418e33e1256e29c24e8abf9fc82d |
File details
Details for the file idatagate-0.0.2-py3-none-any.whl
.
File metadata
- Download URL: idatagate-0.0.2-py3-none-any.whl
- Upload date:
- Size: 55.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.11.9 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c75b1711685de9380e11d9a89e5f819f78ba39e80a09114e8aa0f4c80555967f |
|
MD5 | d29384d1de33fd0cd8d304ed4d2c5d2d |
|
BLAKE2b-256 | 0867caaed1f6e866ef452bb58f9db702f99bd92085d79f600355f67733bec5a0 |