Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.13.tar.gz (33.8 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.13-py3-none-any.whl (38.0 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.13.tar.gz.

File metadata

  • Download URL: echofire-0.1.13.tar.gz
  • Upload date:
  • Size: 33.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.13.tar.gz
Algorithm Hash digest
SHA256 73e8f5776dd0627de143bf1685243a2a157d2e7b89391191a275907414f4249b
MD5 62743039e08a8b0eb5b390b8585f3222
BLAKE2b-256 04e4887c8e727b492399ece9f934995323b725a3eba09e23931b3b215d3e073f

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.13.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 38.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 6a935ea345e219db1a7c975cc7730426d58e3dc330e0521766b495a5ab722348
MD5 6b1a914aefd7969592eb1482d990debb
BLAKE2b-256 bc821ee0758f25bc29f95832a4d860e550ea957d63672b4cf1ad3ca2ce8a43e8

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.13-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page