Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.9.tar.gz (33.7 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.9-py3-none-any.whl (37.9 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.9.tar.gz.

File metadata

  • Download URL: echofire-0.1.9.tar.gz
  • Upload date:
  • Size: 33.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.9.tar.gz
Algorithm Hash digest
SHA256 1e2e3c3bf04c3d2f75f22707093da5779d600d8eb445f3c23106d591aabefe39
MD5 bb86797099ec37ad7b0b81ac74b94f51
BLAKE2b-256 a3dd900b4c668a406a37c8297591a61cef1641d24888e8e0dd747471034596f4

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.9.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 37.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 b9e1116c5ada066997d8e48b13c26efaa8a05bf787990ff6520dd560c2e5a3d7
MD5 072f52fe1e048d0b9c5e9935e6631237
BLAKE2b-256 246138300846c764e7f11ba9e6adf0ef74255c0d8c31b2021e5c476692598865

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.9-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page