Skip to main content

Realistic Voice Agent Testing - Automate end-to-end evaluation of voice agents with human-like audio simulation

Project description

EchoFire

Realistic Voice Agent Testing

Automate end-to-end evaluation of voice agents with human-like audio simulation.

flowchart LR
    A[Record Session With Voice Agent] --> B[Write Tests w/ LLM Judge + Built-in Functions]
    B --> C{Parallel Test Execution}
    C -->|Multiple Iterations| D1[Run Test 1]
    C -->|Multiple Iterations| D2[Run Test 2]
    C -->|Multiple Iterations| D3[Run Test ...]
    D1 --> E[Share Results & Collaborate]
    D2 --> E
    D3 --> E
    E --> F[Build Datasets for Fine-Tuning]
    F --> G[Improve Models & Prompts]
    G --> A

Why EchoFire?

  • 🚫 Manual testing sucks: Listening to every agent response isn't scalable.
  • 🤖 Synthetic TTS isn't real: Simulate actual human speech patterns, background noise, and ASR edge cases.
  • 🔥 Test everything: Validate ASR accuracy, intent logic, and agent responses in one flow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofire-0.1.1.tar.gz (33.3 kB view details)

Uploaded Source

Built Distribution

echofire-0.1.1-py3-none-any.whl (37.5 kB view details)

Uploaded Python 3

File details

Details for the file echofire-0.1.1.tar.gz.

File metadata

  • Download URL: echofire-0.1.1.tar.gz
  • Upload date:
  • Size: 33.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.1.tar.gz
Algorithm Hash digest
SHA256 c4fe77bef44bc619c97d1914dfbbd5cef34a552f7f03a80622f8d4123968a5ff
MD5 bf5303adfb69edbed32dc1233e09d8cf
BLAKE2b-256 0cd0ceae3143dc402bb145853c41caba6440c17621d21abdc4f432961e1a26d7

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.1.tar.gz:

Publisher: publish-to-pypi.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file echofire-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: echofire-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 37.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for echofire-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b8ff9cf4d2b90e1d1794aa2c2644ce1968b0c153f7839eb4f52a49529ed6c379
MD5 8e68a94ea0aec9efca07ae9f06dfb400
BLAKE2b-256 6294807dbdd4c0bcd171b5867d78d516de937d6ba299bba3bbfce2ba919ced9b

See more details on using hashes here.

Provenance

The following attestation bundles were made for echofire-0.1.1-py3-none-any.whl:

Publisher: publish-to-pypi.yml on fw-ai-external/EchoFire

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page