Robot Data Audit (RDA)

Audit robot dataset quality. Local only.

RDA checks LeRobot-format datasets for data integrity, temporal consistency, and motion anomalies. It flags problematic episodes and reports what's wrong. RDA is a diagnostic tool only — it does not guarantee training success rate improvements.

Quick Start

pip install robot-data-audit           # install
rda audit /path/to/dataset             # audit → text + JSON report in <dataset>/rda_report.json

Sample Output

$ rda audit ~/datasets/my_robot_data

  ── Verdict ──
  PASS:    180 (90.0%)
  REVIEW:   15 ( 7.5%)
  EXCLUDE:   5 ( 2.5%)

  ── Top Issues ──
  1. [HIGH ★] Action discontinuity: 3421 spikes across 195 episodes
  2. [MEDIUM] High idle ratio: median 72% idle, 28% effective motion
  3. [LOW] Extreme acceleration spikes: 2847 across 180 episodes

Output options: --format json for scripting, -o FILE to save elsewhere.

Real Audit Results

Audited on ArmnetBench (SO-101 arm, 2,499 episodes) and DROID (100 episodes):

Metric	ArmnetBench (200 ep subset)	DROID (100 ep)
Action spikes detected	5,229	1,428
Median idle ratio	68.6%	70.7%
Median episode duration	22.4s	15.0s
Verdict	All PASS	All PASS

Both are curated benchmark datasets — all episodes pass. RDA also runs on noisier, real-world collections where REVIEW/EXCLUDE verdicts appear more frequently.

Full calibration analysis (ArmnetBench, comparing successful vs failure episodes by label): docs/ARMNETBENCH_CALIBRATION_REPORT.md

Design

Local only — No data leaves your machine. Runs entirely offline.
Diagnostic, not predictive — RDA identifies data issues. Whether fixing them improves training is a separate question and depends on your task, model, and setup.
Statistical anomaly detection — Uses MAD on reference distributions instead of fixed thresholds (no hardcoded 3σ rules). Adapts to each dataset's characteristics.
Universal core metrics — Primary ranking uses 3 platform-independent metrics (duration, spike_count, effective_motion_ratio). Platform-specific signals (velocity, path_length) are optional diagnostics.

See docs/MVP_PRODUCT_SPEC.md for full metric definitions.

Metrics

Tier	Metric	Detects	Cross-platform?
L1	Timestamp monotonicity	Clock resets, duplicates	✅
L1	Frame interval consistency	Irregular sampling	✅
L1	Schema compliance	Missing/extra fields	✅
L2	Temporal gap detection	Time discontinuities	✅
L2	Sensor synchronization	Multi-sensor drift	⚠️
L2	Temporal sufficiency	Idle vs active structure	✅
L3	Velocity spikes	Implausible jumps	️
L3	Motion discontinuities	Jerky trajectories	⚠️
L3	Idle frame detection	Paused segments	✅
L4	Duration outliers	Too short / too long	✅
L4	Spike count outliers	Unusual jerk profiles	✅
L4	Effective motion ratio	Low-activity episodes	✅

CLI Reference

`rda audit`

rda audit /path/to/dataset [OPTIONS]

Option	Description
`-o, --output FILE`	Save JSON report (default: `<path>/rda_report.json`)
`--format [json\|text]`	Output format (default: `text`)
`--platform TEXT`	Robot platform name for Tier 3 normalization
`-v, --verbose`	Verbose output

Exit codes: 0 = no EXCLUDE, 1 = error, 2 = at least one EXCLUDE.

Python API

from rda.audit.dataset_audit import DatasetAuditor
from rda.io.lerobot_loader import iter_episodes, load_lerobot_dataset

dataset_info = load_lerobot_dataset("/path/to/dataset")
auditor = DatasetAuditor()
result = auditor.audit_dataset(dataset_info, iter_episodes("/path/to/dataset"))
print(f"PASS: {result.verdict_counts['PASS']}")

Development

git clone https://github.com/liesliy/rda.git
cd rda
pip install -e ".[dev]"
pytest

Citation

@software{robot_data_audit,
  title     = {Robot Data Audit: Quality Auditing for Robot Manipulation Datasets},
  author    = {Niu Su Tech},
  year      = {2026},
  url       = {https://github.com/liesliy/rda}
}

License

MIT

Metadata

Release files for robot-data-audit 0.9.15

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for robot-data-audit 0.9.15
File	Size	Uploaded
robot_data_audit-0.9.15.tar.gz	259.1 kB	Sep 21, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for robot-data-audit 0.9.15
File	Interpreter	ABI	Platform	Reset
robot_data_audit-0.9.15-py3-none-any.whl 253.7 kB Sep 21, 2026	Python 3	none	any	Details

Total release size: 512.8 kB

Release files / robot_data_audit-0.9.15.tar.gz

Download URL	robot_data_audit-0.9.15.tar.gz
Size	259.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`915eda4ff71347108ea908080bb927416fa7568ae9106878298ea1e2906a87bb`
BLAKE2b-256 checksum How to use checksums	`131948ffa40ccf1dabade112d1fc4566874de4041bf9cf80af6fb1d4a2556d2c`
Upload date	Sep 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.13.12`

Release files / robot_data_audit-0.9.15-py3-none-any.whl

Download URL	robot_data_audit-0.9.15-py3-none-any.whl
Size	253.7 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`808908ccfdfb8b629a84e4ced1f85e83a4a6bd17063db389cb934d40c1ee814d`
BLAKE2b-256 checksum How to use checksums	`f1fce4b0a076d4984ed6184d82afd20d0990945c72aaf545749231b535f0cb33`
Upload date	Sep 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.13.12`