Skip to main content

adduct

PyPI CI License

Adduct finds the defects in your robot demonstration data that will break your policy — before you spend four hours training.

$ adduct scan lerobot/pusht

adduct  ·  lerobot/pusht
lerobot_v3 · 206 episodes · unknown · 10 Hz · action_dim 2
╭──────────────────╮
│ 3 MEDIUM   3 LOW │
╰──────────────────╯
by family: smoothness 3  dynamics 1  stats 1  temporal 1

MEDIUM ▸ The dataset's distribution shifts partway through collection
         → Check for a recalibration, tool change, or operator change midway; consider
treating the segments as separate datasets.
           206 eps  [stats.distribution_drift]

LOW    ▸ State evolves inconsistently with the actions in 2.1% of transitions (206
episodes)
         → Inspect the flagged segments; drop episodes containing resets or frame drops.
           206 eps  [dynamics.forward_residual]

MEDIUM ▸ Same state, different next action in 74 episode(s)
         → Prefer action chunking (ACT) or Diffusion Policy over plain BC.
           74 eps  [temporal.non_markovian_pause]

MEDIUM ▸ Shaky teleoperation in 9 episode(s) (up to 6.3× median jerk)
         → Re-record or smooth the flagged episodes; consider a low-pass filter on
teleop input.
           9 eps  [smoothness.jerk_outlier]

LOW    ▸ 4 episode(s) wander: up to 18.6× the direct path
         → Review the flagged episodes; re-record the ones where the operator was
searching.
           4 eps  [smoothness.path_efficiency]

… 1 more finding(s) — --html or --json for all.
Next: adduct scan lerobot/pusht --html report.html --open

That is a real, unedited run against a real public dataset — about two seconds on a laptop with a warm cache, no GPU, and no video decoded. Findings are ordered by severity × blast radius, so a dataset-wide LOW can outrank a narrow MEDIUM: the top of the list is what to look at first, not simply what is loudest.

Install

pip install adduct
adduct scan lerobot/pusht

Python 3.10–3.13. Point it at a local directory or a Hugging Face Hub owner/name.

Add @revision to pin a Hub dataset to one commit, so a result stays reproducible even if the dataset is re-uploaded under the same id:

adduct scan lerobot/pusht@7628202a2180972f291ba1bc6723834921e72c19

What it checks

Adduct ships 48 detectors across 12 families — 45 run by default, 3 are held back pending recalibration (see below) and reachable with --all. What makes a finding useful is not that something is statistically unusual — it is the mechanism: why this specific defect degrades a trained policy. Every finding carries one, plus the measured value, the threshold it crossed, the affected episodes, and a concrete fix.

Check Why it breaks training
A dead action dimension The policy learns to predict a constant for that joint. When the joint matters at deployment, there is no signal to learn from — and the loss never told you, because predicting a constant is easy.
Declared stats disagreeing with measured data Normalization is computed from stats.json. If it disagrees with the data, every input is scaled wrong — train and validation silently normalize differently, and the loss curve looks fine while the policy learns nothing transferable.
Jitter and jerk outliers Behavior cloning fits the noise. High-frequency teleop tremor becomes a learned output signature, which is both wrong and physically hard on the robot.
Actions that don't explain state transitions The action and observation streams are misaligned. The policy is being asked to learn a mapping that does not exist in the data.
Same state, different next action Plain BC averages the modes and produces the mean of two valid behaviors, which is often a third, invalid one. This is a signal to use action chunking or a diffusion policy, not a bug to fix.
Single-strategy coverage The policy works from the one starting configuration you demonstrated and fails from anywhere else. This is invisible in training metrics and obvious on the robot.

Run adduct list-detectors for the full set, or adduct explain <id> for the mechanism behind any one of them.

What it does not do

Being clear about this matters more than any feature claim:

  • No simulator, no training, no GPU. It reads your data and does statistics on it.
  • No network, except the explicit Hugging Face fetch when you pass a owner/name repo id. Local scans make zero network calls.
  • No telemetry. Nothing about your data, your findings, or your usage is transmitted anywhere. Ever. There is no opt-out because there is nothing to opt out of.
  • It never decodes video by default. It reads Parquet columns, which is why it is fast.
  • It does not catch everything. Some failure modes only show up in a rollout — a policy that is subtly bad at a contact-rich sub-task will look fine to every static check here. Adduct rules out a class of data problems; it does not certify that a dataset is good.
  • The findings are not calibrated against training outcomes yet. They are grounded in documented failure mechanisms, not in a corpus of runs that measures how much each defect actually costs. Treat severity as a triage ordering, not a prediction.
  • Three detectors are excluded from a default scan. Each was measured over-firing on a 20-dataset sweep of curated public LeRobot data, and gating beats deleting. smoothness.discontinuity_jump and integrity.declared_mismatch reported HIGH on 70% and 60% of that corpus. dynamics.inverse_residual fired on 100% of it and reported HIGH on 50%; excluding it drops the corpus from 23 HIGH findings to 13, and the datasets carrying at least one HIGH from 17 of 20 to 11 of 20. Pass --all to run them anyway; nothing is deleted, just held back pending recalibration. Please report them as false positives if they fire on data you trust. The evidence and the method are in benchmarks/.

Measured evidence

The unit suite plants known defects in synthetic fixtures and checks they are found — that measures recall, and it cannot measure precision on healthy data. benchmarks/ holds the runs that measure the other half, on real published datasets.

The latest, A precision audit of robot data-quality detectors (20 datasets, 4,342 episodes, 545,964 frames): all 20 parsed without error in 22.5 s on a laptop CPU, producing 190 findings.

Its most consequential result is not about adduct. 18 of the 20 datasets declare robot_type: "unknown", so any method conditioning on embodiment via Hub metadata collapses to a single bucket on 90% of the corpus — including adduct's own conformal gate.

It is also unflattering about the tool: six detectors fire on 70% or more of curated public data, a median of 9.5 findings per dataset is too many to act on, and one hypothesis for the worst offender was tested and rejected rather than quietly dropped. It is explicit about what it does not show: a fire rate is a rate of complaint, not a rate of correctness, and no policy was trained, so the premise that these defects degrade policies is untested there.

Supported formats

Format Status
LeRobot v2.1 ✅ Autodetected, local or Hub
LeRobot v3.0 ✅ Autodetected, local or Hub
RLDS / Open-X ✅ Needs pip install adduct[rlds]
robomimic HDF5 ✅ Needs pip install adduct[hdf5]
Raw HDF5 ✅ Needs pip install adduct[hdf5]
Zarr replay buffer ✅ Needs pip install adduct[zarr]
NumPy directory ✅ Built in

Using something else? Tell us which format — what gets built next is decided by what people actually have.

Found a false positive?

Please report it. This is the most valuable thing you can send us.

Adduct's only real asset is that its findings are trustworthy, and a detector that cries wolf is worse than no detector. We cannot find those on synthetic data — we need yours.

👉 Report a false positive

You do not need to share your dataset. The detector id, the numbers adduct printed, and why it is wrong is enough to act on.

Using it in CI

By default adduct scan exits 0 whether or not it finds anything, so it never breaks a pipeline you did not ask it to gate. Opt in explicitly:

adduct scan ./data --ci --fail-on HIGH    # exit 1 only when a HIGH finding is present
Exit code Meaning
0 The scan completed. Findings alone do not change this.
1 An internal error, or the --ci --fail-on gate tripped.
2 A usage error: bad path, unknown format, unreadable checkpoint.

Machine-readable output: --json (stable, versioned schema_version), --sarif (SARIF 2.1.0 for GitHub code scanning), --html (a self-contained report). Findings go to stdout; errors, notices, and progress go to stderr, so adduct scan ./data --json - | jq works cleanly.

Python API

import adduct

report = adduct.scan("./my_lerobot_dataset")
for cluster in report.clusters:
    print(cluster.severity, cluster.title)

report.to_json("report.json")

Extending it

Adapters and detectors are plugins discovered through entry points — the same mechanism the built-ins use, with no privileged path for first-party code:

[project.entry-points."adduct.detectors"]
"myteam.my_check" = "my_pkg.checks:MyCheck"

Contributing

See CONTRIBUTING.md. Commits need a DCO sign-off (git commit -s); there is no CLA, and you keep the copyright to what you write.

Security issues: please report privately per SECURITY.md, never as a public issue.

License

Apache-2.0. Copyright 2026 Adduct.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

adduct-0.2.2.tar.gz (951.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

adduct-0.2.2-py3-none-any.whl (221.8 kB view details)

Uploaded Python 3

File details

Details for the file adduct-0.2.2.tar.gz.

File metadata

  • Download URL: adduct-0.2.2.tar.gz
  • Upload date:
  • Size: 951.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.8 {"installer":{"name":"uv","version":"0.12.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for adduct-0.2.2.tar.gz
Algorithm Hash digest
SHA256 baa3ff5c5e93a14a4bf08049e2a22c460d77ca09923493d0530f6927da75df98
MD5 85ad91df9efe9b266c83e3131a2e3db8
BLAKE2b-256 121f8bfb75ff9c23becf01fb96996f932d4203a14a448e0c80faf51f972597f8

See more details on using hashes here.

File details

Details for the file adduct-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: adduct-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 221.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.8 {"installer":{"name":"uv","version":"0.12.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for adduct-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7788fb273c13ce266a4f8f063bc01e07305aab8c29f0f1451c40cd4b315c233e
MD5 90fdf67cd856e2771d5860f9d717e385
BLAKE2b-256 131e6a003754452e4419f303e2bcbcadee7cab0cc9844d766a7d8874163e6ddf

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.2.2 This release

2 files

0.2.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page