Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.
  • 💻 Works locally: Run tests on your machine with a simple CLI - no cloud deployment needed.
  • 🔄 CI/CD ready: Integrate voice agent testing into your continuous integration pipeline.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.17.tar.gz (39.2 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.17-py3-none-any.whl (43.7 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.17.tar.gz.

File metadata

  • Download URL: echofire-0.1.17.tar.gz
  • Upload date:
  • Size: 39.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.17.tar.gz
Algorithm Hash digest
SHA256 a6f929cd2ba4f1caecafe5db4cee59ad3fa36db80cf6e425ab56b6abec9443b3
MD5 abb913e3701d78905d375fdc9ddd94bd
BLAKE2b-256 636ea5bf66a2bebb3dcc0a880daaed282bb4bf8756cc279fc338511582e4e19c

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.17.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.17-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.17-py3-none-any.whl
  • Upload date:
  • Size: 43.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.17-py3-none-any.whl
Algorithm Hash digest
SHA256 c3bc5bcda195b9d5da803df8245dfabe5f444cf267664312c2cea2f695b296c1
MD5 fe9a6ce916d1dbbdb1a01a670354cf25
BLAKE2b-256 b6c54e987d8cfbfd80b1c0980641ecd2647b3877058fbd1df8c640003d613fb6

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.17-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page