Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.6.tar.gz (33.5 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.6-py3-none-any.whl (37.6 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.6.tar.gz.

File metadata

  • Download URL: echofire-0.1.6.tar.gz
  • Upload date:
  • Size: 33.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.6.tar.gz
Algorithm Hash digest
SHA256 f49100f9f1e526fde6a8f3d08df1eb5343dd29dc96a1ebed817b02f708294ac5
MD5 bc70a4e71c120c5e02e954e2e12b532b
BLAKE2b-256 15f748a8a7aa65b67f714aaaa3d16b2a6dd213528d271b131f77db47ad70c713

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.6.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 37.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 79f31224ccdef41a2e6d6d8870de9285f127a652c06e1004c346ec8acc6dbe8c
MD5 819f963c233546c531a2a63fe1e8f86b
BLAKE2b-256 26f02f2dc06f69f23fe4eef20ffda37a1ae694793e93be4fd54239756d806ed2

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.6-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page