Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.4.tar.gz (33.4 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.4-py3-none-any.whl (37.5 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.4.tar.gz.

File metadata

  • Download URL: echofire-0.1.4.tar.gz
  • Upload date:
  • Size: 33.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.4.tar.gz
Algorithm Hash digest
SHA256 44593245c26c194f6d84f60dfbec0f07c38e5389b49cc3c135ef02b579e72984
MD5 040209ef723ac74cc6862e8de1f4b1fc
BLAKE2b-256 7189d21a4106cf41ef0317d19b2689daa91748ad094b9a68f44507e0876720cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.4.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 37.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 3610c6799737cc2f4ac2d0086363b4693a822ac8f749bced197e542d31a4a7fa
MD5 02722c10717ca2da3e64880c1d5f6f54
BLAKE2b-256 75caaf1f04bbd0712413d50786c9fa8dc7117ac1c20ffc6ad279cf2095a6616b

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.4-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page