Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.15.tar.gz (33.9 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.15-py3-none-any.whl (38.1 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.15.tar.gz.

File metadata

  • Download URL: echofire-0.1.15.tar.gz
  • Upload date:
  • Size: 33.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.15.tar.gz
Algorithm Hash digest
SHA256 154a4b8b556936bb0077d6deebc666532f8665bd4de3ed54ea6d751d77d65357
MD5 512d12e2d0c203b27985ed69e190698b
BLAKE2b-256 33863c1a2bef7958913afbba8bfe7df4f872c23dc8315b8567277323b458b621

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.15.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.15-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.15-py3-none-any.whl
  • Upload date:
  • Size: 38.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.15-py3-none-any.whl
Algorithm Hash digest
SHA256 4c8ad412ba8b0f09441d5a591c17165831e89083c703f20d6d1305d4cbfd9092
MD5 87ed88994122ad1c4e2c261a60bfc0ca
BLAKE2b-256 8c8e279e68783728403053b71e05bc29b7b628fbb7774b3d4590d469763f6a51

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.15-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page