Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.12.tar.gz (33.9 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.12-py3-none-any.whl (38.0 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.12.tar.gz.

File metadata

  • Download URL: echofire-0.1.12.tar.gz
  • Upload date:
  • Size: 33.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.12.tar.gz
Algorithm Hash digest
SHA256 b7af9f8a383c7382a23ef53fc263f22dba1e32f410be619e4450f8609b6adeb1
MD5 7225544a5b3e1004339b3b5707c8eb91
BLAKE2b-256 8c9560cc9b04b699e02c5a2f88cf7f194fb2fc7be8159d8f3b7f71233600687a

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.12.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.12-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.12-py3-none-any.whl
  • Upload date:
  • Size: 38.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 929897212b8259128d03e7f966b4620701cca81877438376b5e408fddc7def3f
MD5 9c93345d9d3781b17f019b7f60f5ba02
BLAKE2b-256 e0b513e3e9f8f005c5a34b622382c5ae34d2a9be4ce3ab538e5dde4be8e8902d

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.12-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page