Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.8.tar.gz (33.7 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.8-py3-none-any.whl (37.9 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.8.tar.gz.

File metadata

  • Download URL: echofire-0.1.8.tar.gz
  • Upload date:
  • Size: 33.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.8.tar.gz
Algorithm Hash digest
SHA256 4e878572ce075aba6839a960ae71dccd7f75db2daefa5d86fcb3bbabb962aa14
MD5 0f6615197fb5108d362902138ea6b3e3
BLAKE2b-256 5148dc0891a2e99586809ab366d6b988f37344b260ad42f63f7915fb5905cc6b

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.8.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.8-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.8-py3-none-any.whl
  • Upload date:
  • Size: 37.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.8-py3-none-any.whl
Algorithm Hash digest
SHA256 27ea89f21c2bc17f2120fc7381976f0b5e6492b0855501c53f953fcb4d978ab7
MD5 d23a609190caf074be0eb27db231b699
BLAKE2b-256 4e5ea604854d2de28d731c19c5504eb12abd6a9e391b66c49efc459f0eff472e

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.8-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page