Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.11.tar.gz (34.0 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.11-py3-none-any.whl (38.1 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.11.tar.gz.

File metadata

  • Download URL: echofire-0.1.11.tar.gz
  • Upload date:
  • Size: 34.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.11.tar.gz
Algorithm Hash digest
SHA256 5f189f9649e91e7c626131e80f7c95133098bc1b9a572206e89beb96b512983c
MD5 8233ae219a93b64244f5a0fab77243f7
BLAKE2b-256 3462a99752008c111ffa595679d9aff9195051e0908fab9365a7c38576082c72

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.11.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.11-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.11-py3-none-any.whl
  • Upload date:
  • Size: 38.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.11-py3-none-any.whl
Algorithm Hash digest
SHA256 97fb3761c9ecca048bbdd5958dfefca8a6e178fba5008d70a21e74c24159b12c
MD5 80d42c74097c801f4b558795e8616db4
BLAKE2b-256 59797e0f2f4efe220ee62edd7cd00c42e69fc1aa266aff60e51a4bda3f46b3d8

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.11-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page