SLT Datasets Downloader

Overview

SLT Datasets Downloader is a Python library that allows users to download and process multiple sign language translation (SLT) datasets from different languages. It is designed to facilitate the training of machine learning models for SLT tasks.

Features

• Supports multiple sign language datasets.
• Provides tools for downloading, preprocessing, and tokenizing datasets.
• Compatible with PyTorch for model training.
• Handles different input types (video, pose) and output types (text, gloss).

Supported Datasets

The following datasets are supported:

Installation

To install the library and its dependencies, run:

pip install -r requirements.txt

Usage

Loading a Dataset

from slt_datasets.SLTDataset import SLTDataset

dataset = SLTDataset(
    data_dir="/path/to/dataset",
    input_mode="video",
    output_mode="text",
    split="train"
)

Accessing Samples

sample_input, sample_output = dataset[0]

Visualizing Pose Data

dataset.visualize_pose(0)

Project Structure

 |-src
 | |-slt_datasets
 | | |-SLTDataset.py  # Main dataset loader
 | | |-WordLevelTokenizer.py  # Tokenizer for text processing
 | | |-dataset_comparison.ipynb  # Notebook for dataset comparison
 |-tests
 | |-test_methods.py  # Unit tests for the dataset loader
 |-docs  # Documentation files
 |-requirements.txt  # Dependency list
 |-pyproject.toml  # Project configuration
 |-README.md  # This file

Contributing

Contributions are welcome! Please follow the guidelines in CONTRIBUTING.md and ensure your code passes all tests before submitting a pull request.

License

This project is licensed under the terms of the LICENSE file.

Support

For any issues or questions, please refer to SUPPORT.md or open an issue in the repository.