Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.7.tar.gz (33.5 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.7-py3-none-any.whl (37.6 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.7.tar.gz.

File metadata

  • Download URL: echofire-0.1.7.tar.gz
  • Upload date:
  • Size: 33.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.7.tar.gz
Algorithm Hash digest
SHA256 31445c0b4151ec0f8dc9406f5b8254f783fe203db6a1ad94fbac5aa0f32b6ebd
MD5 e1bf517bd41c05833395f983be862e24
BLAKE2b-256 8141fa985169e0f2b8001a2f64eb67ec241f050b1afd0c3a78f50786b914e073

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.7.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.7-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.7-py3-none-any.whl
  • Upload date:
  • Size: 37.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.7-py3-none-any.whl
Algorithm Hash digest
SHA256 77714786a6740ccd54a191097e04194bb0f6c04033b9bf8d44f899a64f0bd2e7
MD5 e929dcaf49d5bf97059de05587e6894f
BLAKE2b-256 770e86cb6a660ea374200d7fcf859cc4f9fc3c63bd76e7735ac70fcaf56d6b00

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.7-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page