Skip to main content

Multi-session voice web interface for AI coding agents

Project description

AgentWire

Talk to your AI coding agents. From anywhere.

PyPI Python License Discord


The Problem

You're on the couch. Your AI agent is on your workstation. You have an idea.

Old way: Get up. Walk to computer. Type.

AgentWire way: Pull out phone. Hold button. Talk. Done.


What It Does

Push-to-talk voice control for Claude Code or any AI coding assistant running in tmux.

Phone → AgentWire Portal → tmux session → Claude Code
 🎤        (WebSocket)         📺           🤖

From your phone, tablet, or laptop on your network:

  • Hold to speak, release to send
  • Watch agents work in real-time
  • Hear responses via TTS
  • Manage multiple projects simultaneously

Quick Start

# Install
pip install agentwire-dev

# Setup (interactive)
agentwire init
agentwire generate-certs

# Run
agentwire portal start
# Open http://127.0.0.1:8765 in Chrome — voice works immediately

Requirements: Python 3.10+, tmux, ffmpeg, Claude Code

Honest setup time: under a minute to a working voice portal (instant mode: Chrome speech in, browser voice out — robotic but real). ~15 minutes for the full experience: cloned voices via a self-hosted TTS shim, Whisper-grade transcription, phone-from-anywhere (certs + token).

Network & trust model. The portal binds 127.0.0.1 by default — local only. To use it from your phone, set server.host: 0.0.0.0 in ~/.agentwire/config.yaml. Non-loopback binds require an auth token (auto-generated on first start; print it with agentwire portal token) — your phone prompts for it once, then remembers it. Origin checks reject cross-site browser requests on every bind. Still: keep it on a trusted LAN. Never port-forward it or run it on a public-facing VPS — for internet access use Cloudflare Tunnel + Zero Trust. Details in SECURITY.md.

Platform-specific instructions

macOS:

brew install tmux ffmpeg
pip install agentwire-dev

Ubuntu/Debian:

sudo apt install tmux ffmpeg python3-pip python3-venv
python3 -m venv ~/.agentwire-venv && source ~/.agentwire-venv/bin/activate
pip install agentwire-dev

WSL2: Same as Ubuntu. Audio is limited; use as remote worker with portal on Windows host.

tmux config matters. Default tmux has no mouse scroll, a tiny scrollback, and broken copy UX — see Recommended tmux config, or let agentwire init install it for you.


Features

Feature Description
Voice Control Push-to-talk from any device on your network
Multi-Session Run multiple agents on different projects simultaneously
Git Worktrees Same project, multiple branches, parallel agents
Remote Machines SSH into GPU servers and talk to agents there
Worker Orchestration Spawn worker panes, coordinate tasks, voice commands
Safety Hooks 300+ dangerous commands blocked (rm -rf, force push, etc.)
TTS Responses Agents talk back via browser audio
Outbound Channels Email (Resend) + SMS (Quo / OpenPhone) for cross-device notifications
Session Roles Leader/worker patterns for multi-agent workflows

How It Works

1. Create a session:

agentwire new -s myproject -p ~/projects/myproject

2. Open the portal: Visit http://127.0.0.1:8765 in Chrome (or your phone/tablet with LAN access configured)

3. Talk: Hold the mic button, speak your request, release. In instant mode the transcript appears for a quick glance — Enter sends it to Claude Code.

4. Listen: Agent responses are spoken back — browser voice out of the box, or a real TTS model behind a custom shim.


Multi-Agent Orchestration

AgentWire supports orchestrator/worker patterns for complex tasks:

# .agentwire.yml in your project
type: claude-bypass
roles:
  - agentwire
  - voice

Sessions can spawn workers:

agentwire spawn --roles worker  # Creates a worker pane
agentwire send --pane 1 "Implement the auth module"

Workers execute tasks autonomously while the orchestrator coordinates.


Safety

AgentWire blocks dangerous operations before they execute:

  • rm -rf /, git push --force, git reset --hard
  • Cloud CLI destructive ops (AWS, GCP, Firebase, Vercel)
  • Database drops, Redis flushes, container nukes
  • Sensitive file access (.env, SSH keys, credentials)
agentwire safety check "rm -rf /"
# → ✗ BLOCKED: rm with recursive or force flags

agentwire safety status
# → 312 patterns loaded, 47 blocks today

All decisions logged for audit trails.


Voice Configuration

Two tiers, both sides:

default (zero setup, what a fresh install gets): Chrome speech recognition in, browser speechSynthesis out, OS voice when no browser is connected. No GPU, no models, no certs.

custom (bring your own model): any HTTP shim implementing the voice shim contract — ~30 lines wraps anything (Deepgram, whisper.cpp, an expressive emotion-tag model). The bundled servers are reference shims:

# ~/.agentwire/config.yaml
tts:
  backend: "custom"
  url: "http://localhost:8100"     # agentwire tts start (kokoro CPU / chatterbox GPU / qwen / zonos)
  options:
    backend: kokoro
stt:
  backend: "custom"
  url: "http://localhost:8101"     # agentwire stt start (moonshine ONNX, CPU)

Shims can declare capabilities (emotion tags, style instructions) via GET /capabilities — agentwire injects the shim's tool_prompt into the agent's say tooldef so agents actually use them.

Prefer text-only?

Instant mode already needs nothing — just don't press the mic. Agent speech plays through the browser; mute the tab (or close it — with no browser connected the OS voice handles notifications, which you can silence at the system level).


CLI Reference

Session Management
agentwire list                    # List sessions
agentwire new -s <name> -p <path> # Create session
agentwire kill -s <name>          # Kill session
agentwire send -s <name> "prompt" # Send to session
agentwire output -s <name>        # Read output
Worker Panes
agentwire spawn --roles worker    # Spawn worker in current session
agentwire send --pane 1 "task"    # Send to worker
agentwire output --pane 1         # Read worker output
agentwire kill --pane 1           # Kill worker
Voice Commands
agentwire say "Hello"             # TTS (auto-routes to browser)
agentwire alert "Done"            # Text notification (no audio)
agentwire listen start/stop       # Voice recording
agentwire voiceclone list         # Custom voices
Remote Machines
agentwire machine add gpu --host 10.0.0.5 --user dev
agentwire new -s ml@gpu           # Create session on remote
agentwire tunnels up              # SSH tunnels for services
Safety & Diagnostics
agentwire doctor                  # Auto-diagnose issues
agentwire safety status           # Check protection status
agentwire hooks install           # Install Claude Code hooks
agentwire network status          # Service health check

Documentation

Full reference: docs/wiki/INDEX.md

Quick links:


Community


License

Dual-licensed:


AgentWire: For people who have better things to do.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentwire_dev-1.34.0.tar.gz (31.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentwire_dev-1.34.0-py3-none-any.whl (31.2 MB view details)

Uploaded Python 3

File details

Details for the file agentwire_dev-1.34.0.tar.gz.

File metadata

  • Download URL: agentwire_dev-1.34.0.tar.gz
  • Upload date:
  • Size: 31.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.7.20

File hashes

Hashes for agentwire_dev-1.34.0.tar.gz
Algorithm Hash digest
SHA256 ef1921a613c4d96ec7c8171dd797848fa47345d14db961915e0cbd0917027a79
MD5 fe8aa0f18866c8a107c7a194af1358b2
BLAKE2b-256 79a920f52c5bd43b73777f9492b32c5cda83b8840ac1ebb78351e4746fee3a3c

See more details on using hashes here.

File details

Details for the file agentwire_dev-1.34.0-py3-none-any.whl.

File metadata

File hashes

Hashes for agentwire_dev-1.34.0-py3-none-any.whl
Algorithm Hash digest
SHA256 fd2698b688d22c8266fd2a28baf8201f4a9818113d95ecfa9b1bfc81c6fab1be
MD5 359404cbf47a97e697b56cb1ff0aefef
BLAKE2b-256 02dcce4b128ff761e3707ae42588892706a7f6bb1cc92360730e611738f1f54e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page