Robot Data Audit (RDA)
Independent quality assessment for robot data. Runs locally — your data never leaves your machine.
RDA is a diagnostic tool. It does not guarantee training success-rate improvements.
RDA audits robot manipulation datasets (LeRobot format) for integrity, temporal consistency, motion quality and distribution coverage, then generates optimization recommendations calibrated to your target model architecture. Use it as an independent check before you accept a vendor dataset, train a policy, or publish a benchmark.
Install
pip install robot-data-audit
[lerobot] adds .parquet dataset loading, [ui] adds the web dashboard.
Quick start
# 1. Audit a dataset — 18 metrics incl. visual-stream integrity, three-tier verdicts (PASS / REVIEW / EXCLUDE)
rda audit /path/to/lerobot/dataset
# 2. Recommendations calibrated to your model type
rda recommend /path/to/dataset --policy temporal # or frame-wise
# 3. Optional web dashboard
rda ui
rda audit is fully offline. rda recommend computes all metrics locally and sends only aggregated statistics (<1KB) to the rules API — cached for offline reuse, and RDA_API_URL can point to your own server for private deployments.
Why RDA
12 local datasets, 4,959 episodes, one set of default thresholds, zero per-dataset tuning — full table in docs/benchmark.md.
Full audit of lerobot/libero_10 (v3.0) — 379 episodes, 101,469 frames: all 12 applicable integrity checks clean, 0 hard defects; the one REVIEW signal (low-motion heuristic) is discussed honestly. Read the report →
Blind test — we injected 50 defective episodes (5 defect classes, seed=42) into lerobot/pusht and kept 156 as controls. RDA caught all 50 under the broad criterion, precision 1.000 (zero false alarms on controls) under the strict one. Read the blind-test report →
Validated on AgiBotWorld2026 — third-party audit of AgiBot's Phase 3 dataset: all 5 simulation tasks + a real-robot RL package, 1,112 episodes, 4,448 integrity checks with 0 failures, and a 3.1× enrichment of RDA's discontinuity spikes at official human-takeover boundaries. Zero adaptation needed. Read the case study →
Every audit can also render into a shareable single-file HTML report and a README badge:
python tools/rda_render.py rda_report.json --html report.html --badge badge.svg
More: CLI reference & metrics table · experiments · real-world feedback form
Metric provenance
Every metric ships with a four-file provenance record (docs/provenance/<metric>/): algorithm.md (how it works), source.md (public precedents consulted — ideas only), implementation_origin.md (original implementation, zero third-party code), license.md (compliance notes). Covered: all 18 metrics (missing_dropout, invalid_values, schema_consistency, timestamp_validity, joint_limit, video_frame_integrity, video_freeze, video_timestamp_alignment, video_stream_sync, visual_quality, sensor_synchronization, sampling_jitter, velocity_acceleration, action_discontinuity, temporal_sufficiency, idle_ratio, distribution, coverage). Index: docs/provenance/.
Citation
@software{robot_data_audit,
title = {Robot Data Audit: Quality Auditing for Robot Manipulation Datasets},
author = {Niu Su Tech},
year = {2026},
url = {https://github.com/liesliy/rda}
}
MIT License.
1 maintainer
Release files for robot-data-audit 0.7.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| robot_data_audit-0.7.0.tar.gz | 191.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| robot_data_audit-0.7.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 386.6 kB
Release files / robot_data_audit-0.7.0.tar.gz
| Download URL | robot_data_audit-0.7.0.tar.gz |
|---|---|
| Size | 191.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8a0f9b5440368f14d7db63f75b0496c7095fc71d8a475f3674cceeb76c798fe5
|
|
BLAKE2b-256 checksum How to use checksums |
dc4a3e6c08d76b77ad1599bc7e6b857a496a2ed997eb4242ff34ad9560ae1a4a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / robot_data_audit-0.7.0-py3-none-any.whl
| Download URL | robot_data_audit-0.7.0-py3-none-any.whl |
|---|---|
| Size | 195.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
6d9d5b34c620fdc8b45696595d99270fd3d74f00bc9a98b806fbbf458577c06d
|
|
BLAKE2b-256 checksum How to use checksums |
778a91ecfed3543311b8d61dc522540c54e770ca98c1ab594804e936c4d59082
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
