Skip to main content

๐Ÿฉบ A health check for your MCP setup โ€” measure the context tax and hygiene of your MCP servers

Project description

๐Ÿฉบ mcp-checkup

A health check for your MCP setup.

One command that tells you what your MCP servers cost you โ€” in context-window tokens and dollars โ€” and whether they follow basic security hygiene.

CI PyPI Python License Ruff


The problem

Every MCP server you connect injects its full tool schemas into your model's context window โ€” on every single request โ€” before you type a word.

  • GitHub's official MCP server alone consumes ~17,600 tokens per request in tool definitions (autopsy).
  • Teams have burned 72% of a 200k context window on tool definitions before doing any actual work (MCP spec issue #2808).
  • A security audit of publicly exposed MCP servers found 119 out of 119 sampled allowed unauthenticated access to internal tool listings.

You are paying a context tax on every request, and you probably have no idea how big it is. mcp-checkup measures it.

What it looks like

โš ๏ธ Target UX. The WEIGHT column ships in v0.1.0; the HYGIENE column arrives in v0.4.0. Until then the output below is the design we are building toward.

$ uvx mcp-checkup

  ๐Ÿฉบ MCP Checkup โ€” 4 servers, 38 tools

  WEIGHT                                    HYGIENE
  โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€     โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
  github       17,612 tok   $0.053/req     โš  2 tools reachable without auth
  slack         4,105 tok   $0.012/req     โœ“ ok
  filesystem    2,890 tok   $0.009/req     โš  unrestricted root path
  custom-api    9,441 tok   $0.028/req     โš  3 schemas 8ร— over minimal size

  Context tax: 34,048 tokens โ€” 17% of a 200k window, before your first message.

  Run `mcp-checkup --fix` to emit compressed schemas.
  Run `mcp-checkup --fail-over 20000` in CI to stop the bloat from coming back.

Quickstart

uvx mcp-checkup          # or: pip install mcp-checkup

Point it at your client config (.mcp.json, Claude Desktop, Cursor, โ€ฆ) or a running server. That's the whole interface โ€” one command, one report.

Roadmap

Full detail per milestone in ROADMAP.md.

Version Theme One line
v0.1.0 Weigh one server weigh <target> prints a per-tool token table for one server
v0.2.0 Auto-discovery Zero-flag scan of Claude Desktop/Code, Cursor, Windsurf, VS Code
v0.3.0 Dollars & context tax $/request, $/session, and context-tax % per model
v0.4.0 Hygiene Weight (W01โ€“W05) and security (H01โ€“H04) checks, two-pillar report
v0.5.0 CI gate Budget/severity gates, stable exit codes, GitHub Action
v0.6.0 --fix emit Semantic-safe schema compression with before/after report
v0.7.0 Trim proxy + rug-pull pins serve --wrap --trim proxy, changed-since-pin detection
v0.8.0 Shareable reports Self-contained HTML report, badge endpoint, diff command
v0.9.0 Hardening + SDK v2 MCP SDK v2 transport, Windows CI, perf budget
v1.0.0 Stable Frozen CLI/exit codes/schema with a deprecation policy

Status

Early days โ€” the measurement engine is being built in the open. If the context tax bothers you too: โญ star the repo to follow along, open an issue with your worst MCP token bill, or see CONTRIBUTING.md to help build it.

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mcp_checkup-0.1.0.tar.gz (135.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mcp_checkup-0.1.0-py3-none-any.whl (17.3 kB view details)

Uploaded Python 3

File details

Details for the file mcp_checkup-0.1.0.tar.gz.

File metadata

  • Download URL: mcp_checkup-0.1.0.tar.gz
  • Upload date:
  • Size: 135.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for mcp_checkup-0.1.0.tar.gz
Algorithm Hash digest
SHA256 37f1d2cf4a4d6c80c9003bac21039e33ca0a66369a92fa1261da5453da4c7291
MD5 2eeeabb23fe646282f3377f8de7315c9
BLAKE2b-256 5cafb6f968d73b2c95873861ae0720812a8e7aa2668c33e19b08fefca291df6b

See more details on using hashes here.

File details

Details for the file mcp_checkup-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: mcp_checkup-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 17.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for mcp_checkup-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d1a2013c96502319e4f1d3b5fdd665e8a74751bcf1939d1eb98961d898a44231
MD5 3ea0d68ce3148c7b8e69785e74b1e5c5
BLAKE2b-256 8b379782cf0a9881e7fffd69aabdc358eb8ef6586cb90dd84624d695860467ea

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page