mcp-probe-cli 0.1.0

Test your MCP server like you test an API — declarative YAML, CI-ready, zero boilerplate.

mcp-probe-cli

Test your MCP server like you test an API — declarative YAML, CI-ready, zero boilerplate.

Install

pip install mcp-probe-cli

Quick Start

mcp-probe version

Create tests/mcp.yaml:

server:
  command: python
  args: [src/my_server.py]

tests:
  - name: "lists tools"
    call: tools/list
    expect:
      tool_count: 2

Run:

mcp-probe test tests/mcp.yaml

Example Test YAML

server:
  command: python
  args: [src/my_server.py]        # relative to this YAML file's directory
  env:                            # optional — merged with current environment
    LOG_LEVEL: warning

tests:
  # Assert exact tool count
  - name: "lists 3 tools"
    call: tools/list
    expect:
      tool_count: 3

  # Assert a tool name appears in the response
  - name: "echo tool is present"
    call: tools/list
    expect:
      contains: "echo"

  # Call a tool and check output
  - name: "echo returns the input"
    call: tools/call
    params:
      name: echo
      arguments:
        message: "hello"
    expect:
      status: ok           # ok | error
      contains: "hello"

  # Assert the tool call fails
  - name: "unknown tool returns error"
    call: tools/call
    params:
      name: does_not_exist
      arguments: {}
    expect:
      status: error
      contains: "not found"

Commands

Command	Description
mcp-probe test <config>	Run a test suite from a YAML file
mcp-probe test <config> --json	Output results as JSON (for CI parsing)
mcp-probe replay <traces> --server <cmd>	Replay captured traces against a live server
mcp-probe replay <traces> --server <cmd> --diff	Replay and diff against recorded baselines
mcp-probe version	Print the CLI version

GitHub Action

- name: Test MCP server
  uses: mcp-probe/test-action@v1
  with:
    config: tests/mcp.yaml
    github-token: ${{ secrets.GITHUB_TOKEN }}

Links

• GitHub repository
• Full documentation
• Issue tracker

License

MIT