Skip to main content

TestMu A2A CLI

TestMu A2A CLI is a command-line tool for testing AI agents from your terminal. Use it to discover projects and test suites, run agent tests, and retrieve test results.

The CLI supports chat agents, voice agents, and Phone Caller inbound and outbound agents.

Requirements

  • Python 3.10 or newer

Install

python -m pip install agent-testing-cli

Check the available commands:

agent-testing-cli --help

Authenticate

Sign in locally and check the active profile:

agent-testing-cli login
agent-testing-cli auth status

For CI, set both environment variables:

export LT_USERNAME="your-username"
export LT_ACCESS_KEY="your-access-key"

Discover projects and suites

agent-testing-cli projects
agent-testing-cli agents --project PROJECT_ID
agent-testing-cli scenarios --project PROJECT_ID
agent-testing-cli suites --project PROJECT_ID
agent-testing-cli endpoint-profiles --project PROJECT_ID

Use --json when another program or a CI job reads the output.

Run tests

Run a Phone Caller suite:

agent-testing-cli run --project PROJECT_ID --suite SUITE_ID --yes

Wait for the final Phone Caller result:

agent-testing-cli run --project PROJECT_ID --suite SUITE_ID --yes --wait

Run a Chat evaluation:

agent-testing-cli run \
  --project PROJECT_ID \
  --workflow WORKFLOW_ID \
  --suite SUITE_ID \
  --yes

Do not use --wait for Chat evaluations.

Run a test from a result URL:

agent-testing-cli run --url RESULT_URL --yes

Validate a suite file without starting a test:

agent-testing-cli run --file SUITES.json --dry-run

Retrieve results

agent-testing-cli results --suite SUITE_ID
agent-testing-cli call --id CALL_ID

Interactive terminal interface

agent-testing-cli tui

Use agent-testing-cli --help for the complete command and option reference.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agent_testing_cli-0.1.3.tar.gz (34.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agent_testing_cli-0.1.3-py3-none-any.whl (28.7 kB view details)

Uploaded Python 3

File details

Details for the file agent_testing_cli-0.1.3.tar.gz.

File metadata

  • Download URL: agent_testing_cli-0.1.3.tar.gz
  • Upload date:
  • Size: 34.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for agent_testing_cli-0.1.3.tar.gz
Algorithm Hash digest
SHA256 61f6a96da518be53dc38c43181b5cc0bc01ae3bd46e735bbbd528f787a729097
MD5 eaf5de5f70fa08754939f0857db1771c
BLAKE2b-256 21812a631dd62ff1eb8e373f14cc50ade6cd73c72caa925894e1c383c82fec87

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_testing_cli-0.1.3.tar.gz:

Publisher: publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agent_testing_cli-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for agent_testing_cli-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 c1540c7223f3b14c21faab27ab78824bd4467659039111b40074e1f6ec8f32e0
MD5 2a9e1174b25800f09381367667839608
BLAKE2b-256 ff0fd91f6ee1e8ee0d2359e7386e51834691e9c8741b3e6ff0f9359a3d507de3

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_testing_cli-0.1.3-py3-none-any.whl:

Publisher: publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page