Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.10.tar.gz (33.7 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.10-py3-none-any.whl (37.9 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.10.tar.gz.

File metadata

  • Download URL: echofire-0.1.10.tar.gz
  • Upload date:
  • Size: 33.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.10.tar.gz
Algorithm Hash digest
SHA256 1321a23d433ce5c6128d7c95ffefedfa57a6d5754750ed127427b1b116099ee9
MD5 7de543e9dc36ffcf67369ef038e7f551
BLAKE2b-256 6490a6aee7dda923ee4a220d63c84a80ea782159237f853edc3eedf172141c49

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.10.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.10-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.10-py3-none-any.whl
  • Upload date:
  • Size: 37.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.10-py3-none-any.whl
Algorithm Hash digest
SHA256 7ccc4405e54db2077fcdc2e2229f5e9f375d00dbdc87b8415424c5fe08b409c9
MD5 04dbef054d4069cdbb83154645bac613
BLAKE2b-256 72b56ec8a0962ee7a83a36ff40ddec5e73b168b06de4f32964ee0ccdf970657c

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.10-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page