Skip to main content

Easy and performant synthetic dataset generation for VLA models using Isaac Sim multi-env simulation.

Project description

Domin

A high-throughput orchestrator for synthetic robotics datasets; named after Harry Domin of R.U.R., the visionary who sought to free humanity from labor through the mass production of robots.

domin makes the generation of synthetic datasets for Visual-Language-Action (VLA) models easy, performant, and scalable.

While most current simulation in robotics is geared towards Reinforcement Learning (RL), this package leverages the same massively parallel, multi-environment paradigm to generate training data. This allows you to produce large-scale datasets using NVIDIA Isaac Sim and Isaac Lab with a single configuration file.

Features

This package generates datasets in the popular LeRobot format, compatible with Hugging Face's LeRobot library. The core dataset builder is a modified and extended version of the LeRobot dataset builder, optimized for simulation environments.

Key features inherited from our extended dataset_builder:

  • Simultaneous Episode Recording: Record multiple episodes (environments) in parallel for high throughput, significantly speeding up data generation.
  • Story Mode: Episodes are grouped into "stories" (batches) for efficient management and synchronized resetting.
  • Scheduled Re-recording: Robust handling of failed episodes. If an episode fails, it is automatically cleared and scheduled for a retry in the next batch, ensuring dataset completeness without manual intervention.
  • Metadata & Custom Metrics: Easily save arbitrary metadata (e.g., success rates, simulation parameters) and automatically compute episode statistics in the dataset's info.json.
  • LeRobot Format Compatibility: Produces datasets in the standard LeRobot format (Parquet files with embedded or external images), ready for training.

Installation

You can install this package via pip. Note that you must specify the NVIDIA PyPI index for isaacsim and related dependencies.

pip install . --extra-index-url https://pypi.nvidia.com

For advanced installation instructions, including setting up Isaac Sim and creating a development environment, please see CONTRIBUTING.md.

Usage

To generate a dataset, use the domin-gen command with a dataset configuration file.

The dataset configuration file should inherit domin.base_dataset_config.BaseDatasetConfig (see example).

Example

domin-gen examples/dexterous_dataset_config.py --num_envs 10 --num_episodes 100

Arguments

  • config_path: Path to the Python file containing the dataset configuration (e.g., examples/dexterous_dataset_config.py).
  • --num_envs: (Optional) Number of parallel environments to simulate (default: 1).
  • --num_episodes: (Required) Total number of episodes to record.

Acknowledgements

This project builds upon the excellent work of the Hugging Face LeRobot team. The domin.dataset_builder module is a modified adaptation of their dataset building tools, tailored for the specific needs of massive parallel simulation in Isaac Lab. We gratefully acknowledge their contributions to the open-source robotics community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

domin-0.1.0.tar.gz (63.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

domin-0.1.0-py3-none-any.whl (72.1 kB view details)

Uploaded Python 3

File details

Details for the file domin-0.1.0.tar.gz.

File metadata

  • Download URL: domin-0.1.0.tar.gz
  • Upload date:
  • Size: 63.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.13

File hashes

Hashes for domin-0.1.0.tar.gz
Algorithm Hash digest
SHA256 a1cb3c5aec5199c78e27f8426deb926c6fe74bf9106a87660b10ec582f5d22bc
MD5 30f8010dbf5056a00d402c71b3b9708e
BLAKE2b-256 c375951276fa881a03fd4adc7e722f06311ed559f16de93a48d9672c59581f06

See more details on using hashes here.

File details

Details for the file domin-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: domin-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 72.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.13

File hashes

Hashes for domin-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 56536027b03c73344a73bdae73b8f1c2935af34bdabf72b401624c8ba1f8a315
MD5 bdd32cf31d030830b921c95124f497d7
BLAKE2b-256 46c166d7da16c703bf40cafb97f46c0ea7d125b143ddb38e3c247d855c804d09

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page