Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.3.tar.gz (33.4 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.3-py3-none-any.whl (37.5 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.3.tar.gz.

File metadata

  • Download URL: echofire-0.1.3.tar.gz
  • Upload date:
  • Size: 33.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.3.tar.gz
Algorithm Hash digest
SHA256 4080532386a6832b07fa50b22dfa4076c9577795d5a2524bb186c8b2cd45d0fe
MD5 55515ffae89b177615808f1e1775ef47
BLAKE2b-256 d793bd15aa8f1e4bd3c574e918dcd602be5aa44f9b038bc49eec3168fbc84b59

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.3.tar.gz:

Publisher: publish-to-pypi.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 37.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 0b70e6e093d0c83b1822b106c83943f0cfd6d2b18d167bf4713adea8d70d90e7
MD5 0f716912a5446aff5c14d67106594a44
BLAKE2b-256 39c9ef335b0b57c3b375f3de44ec2375ed0df3cbeaf7327357bf371e69c871a8

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.3-py3-none-any.whl:

Publisher: publish-to-pypi.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page