inspect-robots-voice
Local spoken operator feedback for attended Inspect Robots evaluations. The plugin keeps the microphone open during a run, transcribes accepted utterances locally, and sends them through the same operator-message channel as typed console feedback. Parakeet TDT 0.6B v3 is the default; faster-whisper models remain selectable by model name or local path.
Voice input is feedback-only. Spoken words cannot end a trial or record a verdict. Silence and low-confidence transcription candidates produce no message.
Install
pip install inspect-robots-voice
PortAudio must be available for sounddevice on the machine connected to the microphone:
sudo apt install libportaudio2 (Debian and Ubuntu), sudo dnf install portaudio (Fedora),
or brew install portaudio (macOS).
Run
inspect-robots run --task my-task --policy agent --embodiment my-robot --voice
Voice mode requires an attended terminal. Repeat -V key=value to configure it:
| Key | Default | Backend | Meaning |
|---|---|---|---|
model |
parakeet-tdt-0.6b-v3 |
both | Parakeet alias or nemo- name, or a faster-whisper model size or local path |
device |
system default | both | sounddevice input index or case-insensitive name substring |
language |
none |
whisper | explicit transcription language (Whisper uses en when unset); Parakeet auto-detects |
compute |
auto |
whisper | CTranslate2 compute type |
asr_device |
cpu |
whisper | cpu, cuda, or auto |
The default int8 Parakeet weights download once from the Hugging Face hub on first use and use
about 640 MB. Pass -V model=small to restore the previous Whisper default. Explicit language,
compute, and non-CPU asr_device values require a Whisper model.
Parakeet TDT 0.6B v3 weights are provided by NVIDIA under the CC-BY-4.0 license.
For example:
inspect-robots run --task my-task --policy agent --embodiment my-robot \
--voice -V model=medium -V device="USB Microphone" -V compute=int8
Filtering
Audio is segmented locally with an adaptive energy gate. Parakeet applies duration, blank-text, coarse mean-token-confidence, and known silence-hallucination checks. Whisper keeps its bundled VAD plus duration, confidence, no-speech, and known silence-hallucination checks. Rejected candidates disappear silently so the policy receives only accepted operator utterances.
Transcription runs in a worker thread. The rollout loop never waits for speech recognition, and a voice pipeline failure disables voice input without disabling typed console feedback.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file inspect_robots_voice-0.4.0.tar.gz.
File metadata
- Download URL: inspect_robots_voice-0.4.0.tar.gz
- Upload date:
- Size: 29.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
030ddeb728c962bdb87d0cd09c7fa4f5d802fd99d0eb9649d6b14e52beb499c3
|
|
| MD5 |
244f2ca1bd9b7d78efb091b86b4c0940
|
|
| BLAKE2b-256 |
dc458fb1e64d68dbc4c4dcd7fb9654c5388ea16f07ef8fd0d906d3c986cb9539
|
Provenance
The following attestation bundles were made for inspect_robots_voice-0.4.0.tar.gz:
Publisher:
release.yml on robocurve/inspect-robots
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
inspect_robots_voice-0.4.0.tar.gz -
Subject digest:
030ddeb728c962bdb87d0cd09c7fa4f5d802fd99d0eb9649d6b14e52beb499c3 - Sigstore transparency entry: 2365696470
- Sigstore integration time:
-
Permalink:
robocurve/inspect-robots@c8ac6f099218a9fbd815713335834a799818c9f1 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/robocurve
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@c8ac6f099218a9fbd815713335834a799818c9f1 -
Trigger Event:
workflow_dispatch
-
Statement type:
File details
Details for the file inspect_robots_voice-0.4.0-py3-none-any.whl.
File metadata
- Download URL: inspect_robots_voice-0.4.0-py3-none-any.whl
- Upload date:
- Size: 18.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
be02a6a638f50e4132d0fe8fec1d3201881c5851935f5e8afeac6754126e3a52
|
|
| MD5 |
d8e884be0cf1d378e13bf131009879d6
|
|
| BLAKE2b-256 |
6361b570223360d06739b922605f1202974d49b86dcfa56b2073f15f1e5e6a32
|
Provenance
The following attestation bundles were made for inspect_robots_voice-0.4.0-py3-none-any.whl:
Publisher:
release.yml on robocurve/inspect-robots
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
inspect_robots_voice-0.4.0-py3-none-any.whl -
Subject digest:
be02a6a638f50e4132d0fe8fec1d3201881c5851935f5e8afeac6754126e3a52 - Sigstore transparency entry: 2365696493
- Sigstore integration time:
-
Permalink:
robocurve/inspect-robots@c8ac6f099218a9fbd815713335834a799818c9f1 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/robocurve
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@c8ac6f099218a9fbd815713335834a799818c9f1 -
Trigger Event:
workflow_dispatch
-
Statement type: