Skip to main content

Schema budget linter for MCP, OpenAPI, and agent tool catalogs.

Project description

tool-tax

A schema budget linter for agent tools.

tool-tax scans MCP-style tool catalogs, JSON/YAML tool manifests, and OpenAPI files. It can also inspect MCP config files, probe live MCP stdio servers with tools/list, and show the schema tax your agent may pay before the user asks a question.

Use it to rank heavy tools, fail pull requests when catalogs grow, write a slim tool index for progressive loading, and test whether a lazy-schema stdio proxy helps your host.

tool-tax live MCP demo

pipx install tool-tax

tool-tax doctor --mcp-config .mcp.json
tool-tax doctor --include-global --no-probe
tool-tax mcp -- npx -y @modelcontextprotocol/server-filesystem /tmp
tool-tax scan examples
tool-tax diff old-tools.json new-tools.json
tool-tax pack examples --out .tool-tax

Example result:

Tools: 14
Full tool tax: 2,102 est. tokens
Slim index: 647 est. tokens
Slim-index savings: 1,455 est. tokens (69.2%)

Why

Agents keep getting more tools. MCP servers, browser tools, GitHub tools, database tools, and internal APIs all ship long schemas. If every schema is loaded up front, your agent pays a context tax before it starts working.

tool-tax gives that tax a number and lets CI enforce a budget.

Install If

  • You use Claude Code, Cursor, or another agent with multiple MCP servers.
  • You expose internal OpenAPI routes or tool catalogs to an agent.
  • You want CI to catch tool-schema bloat before it lands in a pull request.
  • You need evidence before claiming that a lazy proxy saves runtime context.

Do Not Use If

  • You need a provider billing meter. est. tokens are local estimates.
  • You need a full MCP gateway for resources, prompts, streamable HTTP, or auth.
  • You are trying to compress normal chat prompts or model responses.

What It Does

  • Finds tool definitions in JSON, YAML, and OpenAPI files.
  • Inspects project and user MCP config files for Claude Code, Cursor, VS Code, and Cline.
  • Probes live MCP stdio servers through initialize + tools/list.
  • Estimates token cost for each tool schema.
  • Ranks the most expensive tools.
  • Diffs base/head catalogs for PR budget checks.
  • Generates a slim tool-index.json plus separate schema files.
  • Runs a stdio proxy with list_tools, get_schema, and call_tool wrappers.
  • Fails CI when the tool catalog grows past a budget.
  • Posts or updates a GitHub PR report comment when configured.

Install

From PyPI:

pipx install tool-tax

From GitHub:

pipx install git+https://github.com/SihyeonJeon/tool-tax.git@v0.7.0

From a clone:

git clone https://github.com/SihyeonJeon/tool-tax.git
cd tool-tax
python3 -m pip install -e .

Installs one runtime dependency: PyYAML.

Use

Inspect an MCP config:

tool-tax doctor --mcp-config .mcp.json
tool-tax doctor --mcp-config .cursor/mcp.json --format json
tool-tax doctor --include-global --no-probe

Scan a repo:

tool-tax scan .

Scan a live MCP stdio server:

tool-tax mcp -- npx -y @modelcontextprotocol/server-filesystem /tmp
tool-tax mcp --pack-out .tool-tax-mcp -- npx -y @modelcontextprotocol/server-memory

Run the lazy-schema proxy:

tool-tax proxy -- npx -y @modelcontextprotocol/server-filesystem /tmp
tool-tax proxy --call-timeout 120 -- npx -y @modelcontextprotocol/server-filesystem /tmp

Write Markdown and JSON reports:

tool-tax scan examples --format md --out tool-tax-report.md
tool-tax scan examples --format json --out tool-tax-report.json

Create a progressive-loading pack:

tool-tax pack examples --out .tool-tax

That writes:

.tool-tax/
  tool-index.json       # small always-load index
  schemas/*.json        # full schemas loaded only when needed

Fail CI on tool bloat:

tool-tax scan mcp-tools.json --max-tokens 12000 --max-tool-tokens 750

Compare a pull request:

tool-tax diff base-tools.json head-tools.json --max-delta-tokens 500

Slice a large OpenAPI file before scanning or packing:

tool-tax scan openapi.json --tag payments
tool-tax scan openapi.json --path /v1/payment_intents
tool-tax pack openapi.json --operation "PostPayment*" --out .tool-tax-payments

Use it as a GitHub Action:

- uses: SihyeonJeon/tool-tax@v0.7.0
  with:
    path: .
    max-tokens: "12000"
    max-tool-tokens: "750"

Output

# Tool Tax Report

Grade: **lean**

| Metric | Value |
| --- | ---: |
| Tools | 7 |
| Full tool tax | 1,144 est. tokens |
| Slim index | 309 est. tokens |
| Slim-index savings | 835 est. tokens (73.0%) |
| Worst tool | 255 est. tokens |

Supports

  • Live MCP stdio servers
  • MCP config files with mcpServers
  • Lazy-schema MCP stdio proxy
  • MCP-style JSON/YAML tool arrays
  • Agent tool manifests with name, description, and inputSchema
  • OpenAPI paths operations
  • OpenAPI slicing by --tag, --path, and --operation
  • Nested JSON catalogs
  • GitHub Step Summary and PR comment reports

Benchmarks

These are local estimates for upfront schema text, not provider billing totals. See Estimator for the method and limits.

Catalog Tools Full tool tax Slim index Slim-index savings
Live MCP Filesystem 14 2,102 647 69.2%
Live MCP Memory 9 1,324 340 74.3%
Live MCP Sequential Thinking 1 858 46 94.6%
GitHub REST API 1,184 366,962 70,996 80.7%
Stripe OpenAPI 587 649,797 28,047 95.7%

Direct-vs-proxy upfront schema tax:

Upstream MCP server Direct upfront tax Proxy upfront tax Reduction
Filesystem 2,102 260 87.6%
Memory 1,324 260 80.4%
Sequential Thinking 858 260 69.7%

Host-level benchmarks:

Host shape Result Link
Naive host that repeats visible tool schemas in prompts proxy positive: 90.8% lower startup prompt tokens Naive MCP host benchmark
Claude Code 2.1.143 single known-tool task proxy negative: one extra turn and higher measured cost Claude Code E2E benchmark

Repo Shape

src/tool_tax/   # library + CLI
tests/          # unittest smoke coverage
examples/       # sample MCP/OpenAPI catalogs and reports
docs/           # trend scan and repo structure notes

What It Is Not

  • Not a provider billing meter.
  • Not prompt compression for normal chat messages.
  • Not a security sandbox for untrusted MCP servers.
  • Not a full MCP gateway.
  • Not a universal runtime token saver across all agent hosts.

It measures the up-front schema tax, creates a smaller index, catches catalog growth in CI, and includes an experimental stdio proxy that exposes three wrapper tools so upstream schemas can be fetched only when needed. The proxy is intentionally narrow: stdio, tools/list, and tools/call.

More

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tool_tax-0.7.0.tar.gz (29.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tool_tax-0.7.0-py3-none-any.whl (27.2 kB view details)

Uploaded Python 3

File details

Details for the file tool_tax-0.7.0.tar.gz.

File metadata

  • Download URL: tool_tax-0.7.0.tar.gz
  • Upload date:
  • Size: 29.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tool_tax-0.7.0.tar.gz
Algorithm Hash digest
SHA256 81156ec331a08ae95f0af327bec4b79da6af6818c3a32d0779e0c677e7b545a1
MD5 dca5c4f61c16a6da445f2142a925a4d2
BLAKE2b-256 7ef0dbae8d0fd012db8f2030df2a92617289d2c5f200104672e2c4d643a43953

See more details on using hashes here.

Provenance

The following attestation bundles were made for tool_tax-0.7.0.tar.gz:

Publisher: publish-pypi.yml on SihyeonJeon/tool-tax

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tool_tax-0.7.0-py3-none-any.whl.

File metadata

  • Download URL: tool_tax-0.7.0-py3-none-any.whl
  • Upload date:
  • Size: 27.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tool_tax-0.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 25b3ed27047a909ddb4ba3876d8e3809443528bc3f64389332449df5637cbadd
MD5 9f4d54d375b334e121db89e5e7c2e13c
BLAKE2b-256 81e149eeb0a891b72631f88dedc336eeb95eecfb491d94fe9915d75949d57c1f

See more details on using hashes here.

Provenance

The following attestation bundles were made for tool_tax-0.7.0-py3-none-any.whl:

Publisher: publish-pypi.yml on SihyeonJeon/tool-tax

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page