Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.5.tar.gz (33.5 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.5-py3-none-any.whl (37.6 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.5.tar.gz.

File metadata

  • Download URL: echofire-0.1.5.tar.gz
  • Upload date:
  • Size: 33.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.5.tar.gz
Algorithm Hash digest
SHA256 0a8a009a7cdc57a69ca34e98c82222bb50021ba2bbe04e19247126f8493bf67f
MD5 51f4271122837ac6f50ee67a17de79b8
BLAKE2b-256 f902d7c21ec9502df16b3c57e980d1002bb5ddba6c435093f4997f24737728ae

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.5.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 37.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 580005b21f54e935a925da30051c93d18d7658de3d555604da4568b026ac7a3d
MD5 9345ff63884085fd176838a9df2db622
BLAKE2b-256 2676d013bcf790bfa8a4252741fe9051e7408517c795f514eca005c8efc0f7a7

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.5-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page