Skip to main content

TestMu A2A CLI

TestMu A2A CLI is a command-line tool for testing AI agents from your terminal. Use it to discover projects and test suites, run agent tests, and retrieve test results.

The CLI supports chat agents, voice agents, and Phone Caller inbound and outbound agents.

Requirements

  • Python 3.10 or newer

Install

python -m pip install agent-testing-cli

Check the available commands:

agent-testing-cli --help

Authenticate

Sign in locally and check the active profile:

agent-testing-cli login
agent-testing-cli auth status

For CI, set both environment variables:

export LT_USERNAME="your-username"
export LT_ACCESS_KEY="your-access-key"

Discover projects and suites

agent-testing-cli projects
agent-testing-cli agents --project PROJECT_ID
agent-testing-cli scenarios --project PROJECT_ID
agent-testing-cli suites --project PROJECT_ID
agent-testing-cli endpoint-profiles --project PROJECT_ID

Use --json when another program or a CI job reads the output.

Run tests

Run a Phone Caller suite:

agent-testing-cli run --project PROJECT_ID --suite SUITE_ID --yes

Wait for the final Phone Caller result:

agent-testing-cli run --project PROJECT_ID --suite SUITE_ID --yes --wait

Run a Chat evaluation:

agent-testing-cli run \
  --project PROJECT_ID \
  --workflow WORKFLOW_ID \
  --suite SUITE_ID \
  --yes

Do not use --wait for Chat evaluations.

Run a test from a result URL:

agent-testing-cli run --url RESULT_URL --yes

Validate a suite file without starting a test:

agent-testing-cli run --file SUITES.json --dry-run

Retrieve results

agent-testing-cli results --suite SUITE_ID
agent-testing-cli call --id CALL_ID

Interactive terminal interface

agent-testing-cli tui

Use agent-testing-cli --help for the complete command and option reference.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agent_testing_cli-0.1.2.tar.gz (32.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agent_testing_cli-0.1.2-py3-none-any.whl (28.0 kB view details)

Uploaded Python 3

File details

Details for the file agent_testing_cli-0.1.2.tar.gz.

File metadata

  • Download URL: agent_testing_cli-0.1.2.tar.gz
  • Upload date:
  • Size: 32.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for agent_testing_cli-0.1.2.tar.gz
Algorithm Hash digest
SHA256 a918c248de70ed18cc8a6566da56e9a27a40ffc13088909bbc9ad487ed8ad447
MD5 87954c083f694134c5df1f18e35c1af6
BLAKE2b-256 12300e6b8aa0b90e6b0e0f120a106a2aeddc6a8eae17c1fc8437a8f9d34fa389

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_testing_cli-0.1.2.tar.gz:

Publisher: publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agent_testing_cli-0.1.2-py3-none-any.whl.

File metadata

File hashes

Hashes for agent_testing_cli-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 35e5c214c68b289ca26a2616c878f0d5ead23ef9ea997a53392146aab27999ff
MD5 d10e70a2b9b52617543159b24f0d66c2
BLAKE2b-256 7f5c5bad5c94775d10173f1d6229d60de25118300832fdf8a03f97ce811b86a4

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_testing_cli-0.1.2-py3-none-any.whl:

Publisher: publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page