Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.14.tar.gz (34.0 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.14-py3-none-any.whl (38.1 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.14.tar.gz.

File metadata

  • Download URL: echofire-0.1.14.tar.gz
  • Upload date:
  • Size: 34.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.14.tar.gz
Algorithm Hash digest
SHA256 0a8ef86f161e9e7dbe31320421c395923c2de7b992be2477d95b45fc3e191e00
MD5 d12b1eb5c5380d6e77dfbd8aeead3b2f
BLAKE2b-256 494be95e7fce3620f82e94b316b56201880501e436c2d389db1b78d272d41c2f

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.14.tar.gz:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.14-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.14-py3-none-any.whl
  • Upload date:
  • Size: 38.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.14-py3-none-any.whl
Algorithm Hash digest
SHA256 5725db61388bbcfdb3f39e6f62f69c6a05d871791c9f4814aac8bc6795c78433
MD5 b3773535e647017c8a038f923aed5d73
BLAKE2b-256 cbf0ae277f233fb7b8b7a408b5d9788d7b1ad417bf7c34ad2d02fe5bd09d8577

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.14-py3-none-any.whl:

Publisher: auto-release.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page