Skip to main content

Measure the hidden token bill of MCP and agent tool catalogs.

Project description

tool-tax

See how many tokens your agent tools burn before the user even asks a question.

tool-tax scans MCP-style tool catalogs, JSON/YAML tool manifests, and OpenAPI files. It shows the full schema cost, ranks the heaviest tools, diffs catalog changes in pull requests, and writes a slim tool index for progressive loading.

pipx install tool-tax

tool-tax scan examples
tool-tax diff old-tools.json new-tools.json
tool-tax pack examples --out .tool-tax

Example result:

Tools: 7
Full tool tax: 1,144 est. tokens
Slim index: 309 est. tokens
Potential savings: 835 est. tokens (73.0%)

Why

Agents keep getting more tools. MCP servers, browser tools, GitHub tools, database tools, and internal APIs all ship long schemas. If every schema is loaded up front, your agent pays a context tax before it starts working.

tool-tax gives that tax a number.

What It Does

  • Finds tool definitions in JSON, YAML, and OpenAPI files.
  • Estimates token cost for each tool schema.
  • Ranks the most expensive tools.
  • Diffs base/head catalogs for PR budget checks.
  • Generates a slim tool-index.json plus separate schema files.
  • Fails CI when the tool catalog grows past a budget.
  • Posts or updates a GitHub PR report comment when configured.

Install

From PyPI:

pipx install tool-tax

From GitHub:

pipx install git+https://github.com/SihyeonJeon/tool-tax.git@v0.2.1

From a clone:

git clone https://github.com/SihyeonJeon/tool-tax.git
cd tool-tax
python3 -m pip install -e .

Installs one runtime dependency: PyYAML.

Use

Scan a repo:

tool-tax scan .

Write Markdown and JSON reports:

tool-tax scan examples --format md --out tool-tax-report.md
tool-tax scan examples --format json --out tool-tax-report.json

Create a progressive-loading pack:

tool-tax pack examples --out .tool-tax

That writes:

.tool-tax/
  tool-index.json       # small always-load index
  schemas/*.json        # full schemas loaded only when needed

Fail CI on tool bloat:

tool-tax scan mcp-tools.json --max-tokens 12000 --max-tool-tokens 750

Compare a pull request:

tool-tax diff base-tools.json head-tools.json --max-delta-tokens 500

Use it as a GitHub Action:

- uses: SihyeonJeon/tool-tax@v0.2.1
  with:
    path: .
    max-tokens: "12000"
    max-tool-tokens: "750"

Output

# Tool Tax Report

Grade: **lean**

| Metric | Value |
| --- | ---: |
| Tools | 7 |
| Full tool tax | 1,144 est. tokens |
| Slim index | 309 est. tokens |
| Potential savings | 835 est. tokens (73.0%) |
| Worst tool | 255 est. tokens |

Supports

  • MCP-style JSON/YAML tool arrays
  • Agent tool manifests with name, description, and inputSchema
  • OpenAPI paths operations
  • Nested JSON catalogs
  • GitHub Step Summary and PR comment reports

Repo Shape

src/tool_tax/   # library + CLI
tests/          # unittest smoke coverage
examples/       # sample MCP/OpenAPI catalogs and reports
docs/           # trend scan and repo structure notes

Claim

This tool does not compress prompts by itself. It measures the up-front schema tax and creates a smaller index so your agent can load full schemas later.

It is the measuring tape and CI gate, not a runtime MCP proxy. Use it before or alongside proxy/search tools such as MCP compressors, CLI adapters, and progressive-disclosure gateways.

More

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tool_tax-0.2.1.tar.gz (14.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tool_tax-0.2.1-py3-none-any.whl (14.4 kB view details)

Uploaded Python 3

File details

Details for the file tool_tax-0.2.1.tar.gz.

File metadata

  • Download URL: tool_tax-0.2.1.tar.gz
  • Upload date:
  • Size: 14.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tool_tax-0.2.1.tar.gz
Algorithm Hash digest
SHA256 8bee259f7718a3eaee2cdb83aec7291123eb589fe02a926854b32c5a27c831d6
MD5 a7982457e16c2f55cd9691fb72fa877f
BLAKE2b-256 b803a7f193f79e22ce47810b045fef72155e41a8bb36513d6b4c55c584c621bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for tool_tax-0.2.1.tar.gz:

Publisher: publish-pypi.yml on SihyeonJeon/tool-tax

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tool_tax-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: tool_tax-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 14.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tool_tax-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 916b379560586c3c71983a918dcea0fae18e76aefa16ca830e50fef2670a15c0
MD5 9a8f9c1f8f2f132e3349440ed998e47d
BLAKE2b-256 36fa70c9f867e8188fc42e8faeee4bdb66f3b5b763b1df69d6df0666914d9298

See more details on using hashes here.

Provenance

The following attestation bundles were made for tool_tax-0.2.1-py3-none-any.whl:

Publisher: publish-pypi.yml on SihyeonJeon/tool-tax

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page