Skip to main content

inspect-robots-voice

Local spoken operator feedback for attended Inspect Robots evaluations. The plugin keeps the microphone open during a run, transcribes accepted utterances locally, and sends them through the same operator-message channel as typed console feedback. Parakeet TDT 0.6B v3 is the default; faster-whisper models remain selectable by model name or local path.

Voice input is feedback-only. Spoken words cannot end a trial or record a verdict. Silence and low-confidence transcription candidates produce no message.

Install

pip install inspect-robots-voice

PortAudio must be available for sounddevice on the machine connected to the microphone: sudo apt install libportaudio2 (Debian and Ubuntu), sudo dnf install portaudio (Fedora), or brew install portaudio (macOS).

Run

inspect-robots run --task my-task --policy agent --embodiment my-robot --voice

Voice mode requires an attended terminal. Repeat -V key=value to configure it:

Key Default Backend Meaning
model parakeet-tdt-0.6b-v3 both Parakeet alias or nemo- name, or a faster-whisper model size or local path
device system default both sounddevice input index or case-insensitive name substring
language none whisper explicit transcription language (Whisper uses en when unset); Parakeet auto-detects
compute auto whisper CTranslate2 compute type
asr_device cpu whisper cpu, cuda, or auto

The default int8 Parakeet weights download once from the Hugging Face hub on first use and use about 640 MB. Pass -V model=small to restore the previous Whisper default. Explicit language, compute, and non-CPU asr_device values require a Whisper model.

Parakeet TDT 0.6B v3 weights are provided by NVIDIA under the CC-BY-4.0 license.

For example:

inspect-robots run --task my-task --policy agent --embodiment my-robot \
    --voice -V model=medium -V device="USB Microphone" -V compute=int8

Filtering

Audio is segmented locally with an adaptive energy gate. Parakeet applies duration, blank-text, coarse mean-token-confidence, and known silence-hallucination checks. Whisper keeps its bundled VAD plus duration, confidence, no-speech, and known silence-hallucination checks. Rejected candidates disappear silently so the policy receives only accepted operator utterances.

Transcription runs in a worker thread. The rollout loop never waits for speech recognition, and a voice pipeline failure disables voice input without disabling typed console feedback.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inspect_robots_voice-0.3.0.tar.gz (20.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

inspect_robots_voice-0.3.0-py3-none-any.whl (13.0 kB view details)

Uploaded Python 3

File details

Details for the file inspect_robots_voice-0.3.0.tar.gz.

File metadata

  • Download URL: inspect_robots_voice-0.3.0.tar.gz
  • Upload date:
  • Size: 20.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for inspect_robots_voice-0.3.0.tar.gz
Algorithm Hash digest
SHA256 386c91f93b0a0d5d8e0ebf0e8a15aed4a7b1a93e42d68b970534eb9e82388182
MD5 34dc073056b64acfba9b26d14902439a
BLAKE2b-256 7f09cebb54255b9c179cacf149305ec620093afe66230cbae44590766c20ef91

See more details on using hashes here.

Provenance

The following attestation bundles were made for inspect_robots_voice-0.3.0.tar.gz:

Publisher: release.yml on robocurve/inspect-robots

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file inspect_robots_voice-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for inspect_robots_voice-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 508b8ccc406affb5daca0a2de7ba4bd1b3ef4b60fba9f3cb9923daa0e705d963
MD5 5c12b9d9a92d669e846b1e4413fff5e6
BLAKE2b-256 58775aec61000ddfab0cf6e866a1c098104de6b9484e6a076a5d48711459acbe

See more details on using hashes here.

Provenance

The following attestation bundles were made for inspect_robots_voice-0.3.0-py3-none-any.whl:

Publisher: release.yml on robocurve/inspect-robots

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.5.1

2 files

0.5.0

2 files

0.4.0

2 files

This release

0.3.0 This release

2 files

0.2.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page