Skip to main content

MCP server that retrieves the most relevant source code for a query, within a token budget

Project description

fittok

Retrieve only the relevant source code for a question โ€” instead of the model reading whole files โ€” so an LLM answers codebase questions on a small, focused slice of context. Less input = fewer tokens, lower cost, faster answers.

Works three ways from one install: an MCP server, a CLI, and a Python library โ€” plus a Claude Code plugin that injects context automatically.

๐Ÿ“– Full command reference โ†’ docs/HANDBOOK.md

mcp-name: io.github.likhithreddy/fittok


How it works

codebase โ”€โ”€โ–ถ graphify โ”€โ”€โ–ถ slurp โ”€โ”€โ–ถ readable slice โ”€โ”€โ–ถ LLM answers
             (parse)      (select)   (trim to budget)
  1. graphify โ€” parses the repo with tree-sitter into a knowledge graph of functions / classes / methods (Python, JS, JSX, TS, TSX, Java, Go, Rust).
  2. slurp โ€” scores every node against the question with **semantic embeddings
    • TF-IDF + PageRank**, then selects only the genuinely relevant nodes via a relevance cliff (no budget-padding with noise).
  3. readable output โ€” returns the actual source code of those nodes, top-ranked in full and the supporting tail as signatures, trimmed to a budget. The model answers directly from it.

As you edit, a file watcher (auto-started on first query) updates the graph incrementally โ€” only changed files are re-parsed and merged, and only changed functions re-embed. Graphs and embeddings are cached on disk (~/.cache/fittok). Set FITTOK_AUTOWATCH=false to disable the watcher, in which case an edit triggers a full re-parse on the next query.


Getting the best results (and known limitations)

Ask focused questions

fittok ranks code against your question by semantic similarity. It's most accurate with focused, specific questions โ€” ideally one concern each, and naming the function/component/route when you can.

  • โœ… "How does runSandboxQuery execute and isolate a SQL query?" โ†’ surfaces the exact function + its isolation code.
  • โœ… "How does the querydle client submit a query and render results?" โ†’ surfaces the UI component.
  • โš ๏ธ "Trace the full feature end-to-end โ€” UI, routes, streaming, auth, and DB isolation" โ†’ one embedding tries to cover many concerns; the most "popular" concern (often auth/utilities) can dominate the ranking and crowd out the part you care about. If the slice misses the file you need, the model will (correctly) read it โ€” so you lose the token savings.

Rule of thumb: one concern per question (or 2โ€“3 facets max). For "explain the whole feature," split it into a few focused questions instead of one mega-query.

Known limitations

  • Broad / abstract multi-facet queries can miss the key file. The embedding model has a ceiling matching code to vague natural language โ€” a key function with a generic name can rank below a semantically-adjacent utility. Mitigation: focused queries, or name the symbol. (A stronger/code-tuned embedding model, set via FITTOK_EMBED_MODEL, is the lever to push past this.)
  • Incremental edge-loss: editing a file can drop call/import edges into it from unchanged files until a full re-parse. fittok auto-recovers on restart or reset_graph.
  • Token budgets are approximate: counts use cl100k_base, so real usage drifts ~10โ€“20% vs Claude's tokenizer (headroom is built into the budget constants).
  • Very large repos: PageRank is not yet vectorized โ€” fine through low-thousands of nodes, slower beyond that.

None of these block normal use; focused queries sidestep the first (the only one you're likely to feel).


Installation

fittok ships as an MCP server, a CLI, and a Python library. It uses torch for embeddings, so a Python runtime must be present. Pick one runtime below, then follow the section for your client.

Every config below launches fittok as uvx fittok. If you chose Python or pipx, swap that for python -m fittok or pipx run fittok respectively.

Prerequisites โ€” choose a runtime (one of)

A. uv โ€” recommended (no Python needed on the machine)

curl -LsSf https://astral.sh/uv/install.sh | sh   # Linux / macOS
winget install astral-sh.uv                        # Windows
brew install uv                                    # macOS (Homebrew)

Launch command: uvx fittok โ€” uv provisions its own Python + all deps in isolation. One static binary, so it's deployable org-wide via MDM/Intune/winget.

B. Python 3.10+ (already on the machine)

python -m pip install fittok      # Linux / macOS
py    -m pip install fittok       # Windows

Launch command: python -m fittok (Windows: py -m fittok).

Managed Linux may reject pip install with PEP 668 ("externally-managed-environment") โ€” use option A to avoid it.

C. pipx โ€” isolated, no global install

brew install pipx                               # macOS
pip install --user pipx && pipx ensurepath      # Linux / Windows

Launch command: pipx run fittok.

MCP server โ€” Claude Code

claude mcp add fittok -s user -- uvx fittok

Restart Claude Code โ†’ /mcp โ†’ confirm fittok is connected, then ask codebase questions normally.

MCP server โ€” VS Code / GitHub Copilot Chat

code --add-mcp '{"name":"fittok","command":"uvx","args":["fittok"]}'

Or paste into .vscode/mcp.json (workspace) or your user mcp.json:

{ "servers": { "fittok": { "type": "stdio", "command": "uvx", "args": ["fittok"] } } }

Then in Copilot Chat: Agent mode โ†’ enable fittok's tools (Configure Tools).

MCP server โ€” GitHub Copilot CLI

copilot mcp add fittok -- uvx fittok
copilot mcp get fittok          # verify status + tools

MCP server โ€” Cursor / Windsurf / any MCP client

{ "mcpServers": { "fittok": { "command": "uvx", "args": ["fittok"] } } }

Auto-trigger (optional, every MCP client)

To make fittok fire on every codebase question โ€” without naming it โ€” and stop your client from re-reading files fittok already returned (which would discard the savings), add this one line to your client's instructions file:

"For any codebase question, call fittok first and answer from its output โ€” don't re-read files it already returned code from."

The first half triggers fittok; the second keeps the client from opening the same files afterward. They reinforce each other โ€” one shapes strategy (use fittok), the other stops the double-read. For a stronger, more explicit block:

For any codebase question ("how does X work", "where is Y"):

  1. Call the fittok MCP tool first, once.
  2. Answer directly from its optimized_context โ€” it is the real, authoritative source for that question.
  3. Do NOT read or grep the files fittok already returned code from. That discards the token savings fittok exists to provide.

For the strongest effect, put it in your user-global instructions so it applies to every repo, not just one:

Client Instructions file
Claude Code CLAUDE.md (repo) or ~/.claude/CLAUDE.md (user-global)
GitHub Copilot .github/copilot-instructions.md or Copilot user instructions
Cursor .cursor/rules/*.mdc (or .cursorrules)
Windsurf .windsurfrules

fittok also bakes this rule into every response (an "answer from this, don't re-read" line above the code), so it works even without the snippet above โ€” the snippet just makes it the client's default across all questions.

CLI

cd /path/to/your/repo

uvx fittok index                                      # optional pre-warm (~15s, cached)
uvx fittok query "how does auth work"                 # LLM answers from relevant code
uvx fittok query "how does auth work" --budget 1500   # cap the slice at 1500 tokens
uvx fittok query "how does auth work" --code          # raw relevant code, no LLM
uvx fittok graph                                      # interactive browser graph
uvx fittok graph --query "auth"                       # graph with relevant nodes highlighted

query sends the relevant code slice to an LLM and streams the answer. Set one key in your shell and it just works:

export ANTHROPIC_API_KEY="sk-ant-..."   # โ†’ claude-haiku-4-5  (recommended)
export OPENAI_API_KEY="sk-..."          # โ†’ gpt-4o-mini  (fallback)

Users of Claude Code already have ANTHROPIC_API_KEY set โ€” no extra step needed. If neither key is set, fittok falls back to --code and prints a setup hint.

graph requires pyvis: uv pip install "fittok[ui]".

Python library

uv add fittok            # in a uv project   (or:  uv pip install fittok  in a venv)
from fittok import optimize

result = optimize("/path/to/repo", "how does authentication work", token_budget=1500)
print(result["optimized_context"])   # the relevant code slice
print(result["savings"])             # token reduction stats

Upgrading

uvx caches the environment, so a new fittok release isn't picked up automatically โ€” server restarts reuse the cached version. Upgrade with one command (no need to re-register the MCP server):

uvx --refresh fittok        # re-resolve from PyPI โ†’ latest version

Then restart the MCP server (reload the window in VS Code, or restart the Copilot CLI) so it boots the new version. For other runtimes:

  • pip: python -m pip install --upgrade fittok
  • pipx: pipx upgrade fittok

Token savings โ€” honest numbers

On a real Next.js/TS repo (~5k functions), fittok returns a ~1.5โ€“3.5k-token slice instead of the model reading 15โ€“20k+ tokens of files โ€” an ~80โ€“90% reduction on input, deterministic and reported in the savings footer.

On Opus 4.8, a broad question cost ~84k total tokens without fittok vs ~27k with it โ€” because fittok replaced a 58k-token Explore subagent with one tool call.

How to measure it honestly:

  • Use the ๐Ÿช™ saved X% footer or your API bill (total tokens).
  • Do not judge by Claude Code's /context Messages number โ€” it excludes subagent tokens and is dominated by model reasoning, which fittok doesn't touch.

Configuration

Variable Default Description
ANTHROPIC_API_KEY โ€” Enables LLM answers via claude-haiku-4-5
OPENAI_API_KEY โ€” Fallback LLM via gpt-4o-mini
FITTOK_SHOW_SAVINGS true ๐Ÿช™ saved X% footer on MCP answers; set false to disable
FITTOK_AUTOWATCH true Auto-start the file watcher so graph updates are incremental (only changed files re-parse); set false to fall back to full re-parse on edits
FITTOK_EMBED_MODEL all-MiniLM-L6-v2 Embedding model
FITTOK_DEVICE auto auto / cuda / mps / cpu
FITTOK_CACHE_DIR ~/.cache/fittok Cache location

Full reference: docs/HANDBOOK.md


Requirements

Python โ‰ฅ 3.10. First run downloads a ~90 MB embedding model. Optional extras:

  • uv pip install "fittok[ui]" โ€” graph visualizer (fittok graph)
  • uv pip install "fittok[gpu]" โ€” torch/CUDA for GPU-accelerated embeddings

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fittok-0.7.1.tar.gz (247.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fittok-0.7.1-py3-none-any.whl (62.5 kB view details)

Uploaded Python 3

File details

Details for the file fittok-0.7.1.tar.gz.

File metadata

  • Download URL: fittok-0.7.1.tar.gz
  • Upload date:
  • Size: 247.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fittok-0.7.1.tar.gz
Algorithm Hash digest
SHA256 ea16569a00c300a971370e257ca23047170490a43ce42ed79307a07f73957fba
MD5 a60efa39cf81889be8cdd83dc7ff5b31
BLAKE2b-256 f2021769dd45e749fd701cf82f8693eb39b107e02e32b5ae40bf32cc6ce9cccb

See more details on using hashes here.

File details

Details for the file fittok-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: fittok-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 62.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fittok-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2b84df2976755cde2ef8f70d116ac6b3c221f1a0e6b04d24334c5b6f0127ba88
MD5 c27779dfbfb0b4a8e7eb2c258c1e8671
BLAKE2b-256 894278a5d3425997daeab963cab5e5e5670a1f2ce398f63f242bf1ea9a215307

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page