Skip to main content

Training-readiness checks for LeRobot-style robotics datasets.

Project description

lerobot-quality-gates

lerobot-quality-gates checks whether a LeRobot-style robotics dataset is ready for training, review, or publication. It focuses on boring but expensive data issues: missing metadata, inconsistent episode boundaries, timestamp drift, broken camera/video references, action/state shape mismatches, missing intervention labels, and weak dataset-card documentation.

The default checks work on local mock LeRobot v3-style folders and do not download full robot datasets.

Quickstart

python -m venv .venv
. .venv/bin/activate
pip install lerobot-quality-gates
lerobot-quality-gates check examples/mock_lerobot_v3_good --out report.md
lerobot-quality-gates check examples/mock_lerobot_v3_bad --format json --fail-on medium
lerobot-quality-gates check --hf-repo owner/dataset-name --format hf-card --out QA.md

--hf-repo fetches only lightweight repository files such as README.md, meta/info.json, and meta/episodes.json; it does not download videos or full robot data shards.

What It Checks

  • meta/info.json exists and declares fps, features, splits, robot type, and total episodes;
  • episode records have ids, tasks, frame counts, timestamp ranges, and data/video references;
  • timestamps are monotonic and match frame counts;
  • action/state shapes match declared features;
  • camera features have corresponding video files;
  • intervention/recovery labels are present when the dataset claims HIL/recovery data;
  • README or dataset card clearly labels mock/tutorial data and documents limitations;
  • optional badge JSON can be generated for docs or static hosting.

What This Is Not

This is not a robot safety certification, benchmark leaderboard, or claim that a dataset is expert-reviewed. It is a deterministic data-quality gate that helps robotics teams find review gaps before training.

All bundled examples are mock/tutorial datasets.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lerobot_quality_gates-0.1.0.tar.gz (11.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lerobot_quality_gates-0.1.0-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file lerobot_quality_gates-0.1.0.tar.gz.

File metadata

  • Download URL: lerobot_quality_gates-0.1.0.tar.gz
  • Upload date:
  • Size: 11.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for lerobot_quality_gates-0.1.0.tar.gz
Algorithm Hash digest
SHA256 bbc415abbebf2834502a810baf90701889ed129074eef488a28c04d867ca973e
MD5 3c5e31e99dae7b9980c288e1937469a5
BLAKE2b-256 13ba206c975f657ca95e1e20d0e6925bba945bd9ec5cdb1b197e2eaea4a2ef4b

See more details on using hashes here.

Provenance

The following attestation bundles were made for lerobot_quality_gates-0.1.0.tar.gz:

Publisher: release-python.yml on auraoneai/lerobot-quality-gates

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lerobot_quality_gates-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for lerobot_quality_gates-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 da420e14ef8bb49b0f62416395c13408f9a1b0846a281ee5aaf83b6cf684dc9a
MD5 b7cf1b79b1263d8d2b931e3c25cfd413
BLAKE2b-256 23ceee09594e549360fb43f8d73f0432ee0972266efef0517472459c958ed3d8

See more details on using hashes here.

Provenance

The following attestation bundles were made for lerobot_quality_gates-0.1.0-py3-none-any.whl:

Publisher: release-python.yml on auraoneai/lerobot-quality-gates

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page