Skip to main content

mcp-probe-cli

Test your MCP server like you test an API — declarative YAML, CI-ready, zero boilerplate.

Install

pip install mcp-probe-cli

Quick Start

mcp-probe version

Create tests/mcp.yaml:

server:
  command: python
  args: [src/my_server.py]

tests:
  - name: "lists tools"
    call: tools/list
    expect:
      tool_count: 2

Run:

mcp-probe test tests/mcp.yaml

Example Test YAML

server:
  command: python
  args: [src/my_server.py]        # relative to this YAML file's directory
  env:                            # optional — merged with current environment
    LOG_LEVEL: warning

tests:
  # Assert exact tool count
  - name: "lists 3 tools"
    call: tools/list
    expect:
      tool_count: 3

  # Assert a tool name appears in the response
  - name: "echo tool is present"
    call: tools/list
    expect:
      contains: "echo"

  # Call a tool and check output
  - name: "echo returns the input"
    call: tools/call
    params:
      name: echo
      arguments:
        message: "hello"
    expect:
      status: ok           # ok | error
      contains: "hello"

  # Assert the tool call fails
  - name: "unknown tool returns error"
    call: tools/call
    params:
      name: does_not_exist
      arguments: {}
    expect:
      status: error
      contains: "not found"

Commands

Command Description
mcp-probe test <config> Run a test suite from a YAML file
mcp-probe test <config> --json Output results as JSON (for CI parsing)
mcp-probe replay <traces> --server <cmd> Replay captured traces against a live server
mcp-probe replay <traces> --server <cmd> --diff Replay and diff against recorded baselines
mcp-probe version Print the CLI version

GitHub Action

- name: Test MCP server
  uses: mcp-probe/test-action@v1
  with:
    config: tests/mcp.yaml
    github-token: ${{ secrets.GITHUB_TOKEN }}

License

MIT

Metadata

Release files for mcp-probe-cli 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mcp-probe-cli 0.1.0
File Size Uploaded Provenance Actions
mcp_probe_cli-0.1.0.tar.gz 10.0 kB Without provenance Details for mcp_probe_cli-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for mcp-probe-cli 0.1.0
File Interpreter ABI Platform Actions
mcp_probe_cli-0.1.0-py3-none-any.whl Python 3 none any Details for mcp_probe_cli-0.1.0-py3-none-any.whl

Total release size: 20.9 kB

Release files / mcp_probe_cli-0.1.0.tar.gz

Download URL mcp_probe_cli-0.1.0.tar.gz
Size 10.0 kB
Tags Source
SHA-256 checksum
How to use checksums
7ff16a050a32684a865f010faaeae2d930310720fc3e494944bf2d6d234e228b
BLAKE2b-256 checksum
How to use checksums
aa1569c2ebe1ca5397d076f63165a8f6619e9bc92f67a43a4be0590ad5d5ef40
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Release files / mcp_probe_cli-0.1.0-py3-none-any.whl

Download URL mcp_probe_cli-0.1.0-py3-none-any.whl
Size 10.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
037f7a28557acbe3f94a85713fab0f1b479e136122142eceb5ea23e1b43c7a39
BLAKE2b-256 checksum
How to use checksums
7515f7a261b9d14fa33c083893532d9270e6a3ab16da16b722b9bbde7bd64ca7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Security for mcp-probe-cli 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page