TestMu Agent Testing CLI
TestMu Agent Testing CLI is a command-line tool for testing chat, voice, and Phone Caller agents from your terminal. Discover projects and test resources, run evaluations, retrieve results, and automate test runs in CI/CD.
Requirements
- Python 3.10 or newer
- A TestMu account with access to Agent Testing
Install
Install the latest published version:
pip install agent-testing-cli
Check the available commands:
agent-testing-cli --help
Authenticate
Before you sign in, see Get started with TestMu Automation to obtain your username and access key.
Sign in locally. Enter your TestMu username and access key when prompted:
agent-testing-cli login
Check sign-in status:
agent-testing-cli auth status
For CI/CD, store these values as protected secrets and set both environment variables:
export LT_USERNAME="YOUR_USERNAME"
export LT_ACCESS_KEY="YOUR_ACCESS_KEY"
Discover Test Resources
agent-testing-cli projects
agent-testing-cli --project PROJECT_ID scenarios
agent-testing-cli --project PROJECT_ID suites
agent-testing-cli --project PROJECT_ID endpoint-profiles
Use --json when a script or CI/CD job reads the output:
agent-testing-cli --json projects
Run Tests
For a Phone Caller run, --project PROJECT_ID identifies the TestMu project
and --suite SUITE_ID identifies the suite to run:
agent-testing-cli --project PROJECT_ID run --suite SUITE_ID
Use --yes to confirm a run without an interactive prompt:
agent-testing-cli --project PROJECT_ID run --suite SUITE_ID --yes
Run a Chat evaluation:
agent-testing-cli --project PROJECT_ID run \
--workflow WORKFLOW_ID \
--suite SUITE_ID \
--yes
Do not use --wait with a Chat evaluation.
Run a suite from a supported TestMu result URL:
agent-testing-cli run --url "SUITE_URL" --yes
Run multiple suite URLs in one command:
agent-testing-cli run --url "SUITE_URL_1" "SUITE_URL_2" "SUITE_URL_3" --yes
Retrieve Results
agent-testing-cli results --suite SUITE_ID
agent-testing-cli call --id CALL_ID
Interactive Terminal Interface
Open the interactive terminal user interface (TUI):
agent-testing-cli tui
Use agent-testing-cli --help for the complete command and option reference.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file agent_testing_cli-0.1.4.tar.gz.
File metadata
- Download URL: agent_testing_cli-0.1.4.tar.gz
- Upload date:
- Size: 36.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3ff0d03652c8e0868d2cd3e0af1b580e79e4f9e4fa1cff61569a44961d402c40
|
|
| MD5 |
b52412e9bc5ce3ec3b2b3c7bde61571e
|
|
| BLAKE2b-256 |
9c8a7bcdd2bbc70f1c0b98f1643f28a708a454b7afddbc1a1976daad159ac020
|
Provenance
The following attestation bundles were made for agent_testing_cli-0.1.4.tar.gz:
Publisher:
publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
agent_testing_cli-0.1.4.tar.gz -
Subject digest:
3ff0d03652c8e0868d2cd3e0af1b580e79e4f9e4fa1cff61569a44961d402c40 - Sigstore transparency entry: 2498399456
- Sigstore integration time:
-
Permalink:
LambdatestIncPrivate/Agent-testing-CLI@a4421dd6dd332e14313767a85dc55db79388a7f8 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/LambdatestIncPrivate
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-pypi.yml@a4421dd6dd332e14313767a85dc55db79388a7f8 -
Trigger Event:
push
-
Statement type:
File details
Details for the file agent_testing_cli-0.1.4-py3-none-any.whl.
File metadata
- Download URL: agent_testing_cli-0.1.4-py3-none-any.whl
- Upload date:
- Size: 29.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
08bcafaee9bf52c9b2e818459b51cb11b8843df1963f91116eff91eb051b8e76
|
|
| MD5 |
87964cae5133bf1d4b826eec0e4d87c8
|
|
| BLAKE2b-256 |
77e23e83daa58987793712ac8fcdfcef7514231e2c1ea5fa2d18ee7d54985fd7
|
Provenance
The following attestation bundles were made for agent_testing_cli-0.1.4-py3-none-any.whl:
Publisher:
publish-pypi.yml on LambdatestIncPrivate/Agent-testing-CLI
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
agent_testing_cli-0.1.4-py3-none-any.whl -
Subject digest:
08bcafaee9bf52c9b2e818459b51cb11b8843df1963f91116eff91eb051b8e76 - Sigstore transparency entry: 2498399461
- Sigstore integration time:
-
Permalink:
LambdatestIncPrivate/Agent-testing-CLI@a4421dd6dd332e14313767a85dc55db79388a7f8 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/LambdatestIncPrivate
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-pypi.yml@a4421dd6dd332e14313767a85dc55db79388a7f8 -
Trigger Event:
push
-
Statement type:
