Skip to main content

A local context layer for AI tools: mirror your repositories, index them into a knowledge graph, and serve it over MCP.

Project description

contextlake, all your real context in one local lake. Pebble the otter surfacing from a misty lake cradling a glowing pebble of context.

contextlake

All your real context, in one local lake.

A local context layer for your AI tools: mirror your repositories, index them
into a knowledge graph, and serve it over MCP, so agents answer from real source instead of guessing.

CI PyPI Python 3.9+ Offline-first License: MIT


Why contextlake

Your AI assistant is only as good as what it can actually see. Point it at one file and it's sharp; ask it about the system, which service calls this API, who depends on that package, where a symbol is really defined across dozens of repos, and it starts guessing.

contextlake gives your tools the real source to read. It mirrors your repositories to your machine, indexes them into a queryable knowledge graph, and serves that graph to your editor over MCP. Everything runs locally and offline, no code leaves your machine, and it carries no credentials of its own.

How it works

contextlake is three layers you adopt one at a time. The mirror is useful on its own, and each layer above it is optional.

contextlake architecture. On the left, your repos: a GitLab group, plus optional Figma, Jira, and other MCP connectors. In the centre, contextlake indexes and mirrors them into a graph and embeddings, a wiki, and connectors. On the right, it serves the result over MCP to your AI tools: Claude Code, Windsurf, Kiro, Cursor, and Postman.

  1. Mirror: clone every repo you can reach in a GitLab group into a faithful copy of its namespace tree, each on its most active branch, kept fresh with one command. (The source is GitLab today; the design is source-agnostic.)
  2. Knowledge layer (optional): parse the mirror into a code + dependency graph, add semantic search, a council-verified wiki, and connectors to Atlassian / Figma / GitLab.
  3. Serve: expose it all over MCP and an offline interactive graph visualizer, so agents can answer "where is X defined?" or "who calls Y?" instead of grepping.

Each layer has its own guide: the mirror in Usage & config, the knowledge layer and serving in Knowledge layer, and the whole flow start to finish in QUICKSTART.

Install

pip install contextlake             # the mirroring CLI
pip install "contextlake[kb]"       # + the knowledge layer (graph, search, wiki, MCP server)

Prefer an isolated, zero-setup install? uv fetches the right Python and an isolated environment for you:

uv tool install "contextlake[kb]"            # install the CLI on your PATH
uvx --from "contextlake[kb]" contextlake --help   # …or run it once, without installing
# pipx install "contextlake[kb]"             # pipx works too
From source (for contributors)
git clone https://github.com/sayak-sarkar/contextlake && cd contextlake
pip install -e ".[kb]"

Prerequisites: git, and, only for GitLab mirroring, an authenticated glab (glab auth login). The knowledge layer needs neither. Once installed, contextlake, python -m contextlake, and python3 contextlake.py are equivalent.

Quickstart: one repo, no setup

You don't need GitLab or any config to try contextlake on a repo you already have. No install? Run it once with uvx: prefix any command below with uvx --from "contextlake[kb]" (e.g. uvx --from "contextlake[kb]" contextlake index --source .).

contextlake index                     # parse the current repo into a local knowledge graph
contextlake graph --overview --open   # open the interactive graph in your browser
contextlake serve                     # …or serve it to your AI IDE over MCP

Wire it into your editor in one line, no config file needed (it uses the local ~/.contextlake/kb store you just built):

claude mcp add contextlake -- contextlake serve      # Claude Code
# zero-install variant: claude mcp add contextlake -- uvx --from "contextlake[kb]" contextlake serve

The contextlake graph visualizer showing a repository's symbols as a navigable node graph, with a type-glyph legend, search, and a corner minimap

contextlake graph, a whole codebase as one offline, navigable graph.

Everything lands in a local store (~/.contextlake/kb), nothing leaves your machine. Index any path with --source PATH, or every git repo under a directory with --workspace DIR.

Want the full path, mirror a GitLab fleet → graph → wired editor in a few minutes? QUICKSTART.md walks the whole flow.

Fleet mode: mirror a GitLab group

Where contextlake goes beyond single-repo tools is mirroring and cross-referencing a whole GitLab fleet. Copy the example config and set your group + workspace:

cp .contextlake.ini.example ~/.contextlake.ini
[contextlake]
work_dir = ~/work
gitlab_group = your-gitlab-group
contextlake status      # see where you stand (read-only)
contextlake sync        # fetch → clone → update → branches → verify → audit

It carries no credentials of its own (auth rides on your existing glab login), so .contextlake.ini holds only non-secret settings and is gitignored by default. It runs across hundreds of repos concurrently, with an adaptive worker pool, retries with backoff, and never stomps on the feature branch you're in the middle of.

Behind a slow / TLS-inspecting corporate proxy (e.g. Zscaler) where glab's API calls time out? Set GITLAB_TOKEN (a read_api token) and contextlake enumerates projects via its own HTTP client, which tolerates the slow DNS where glab's short dial timeout fails.

Commands at a glance

Run any command as contextlake <command>. Full per-command docs: docs/usage.md.

Command What it does
status Show the workspace sync state vs GitLab (read-only)
sync The full pipeline: fetch → clone → update → branches → verify → audit
fetch · clone · update The sync steps, individually
branches Switch each repo to its most active branch
verify · audit Check the mirror vs GitLab; report repo health, age & drift (JSON + CSV)
bootstrap Turnkey: sync + index + connect + embed + wiki + steer
index Build the code/dependency graph (--workspace, incremental, --watch)
connect Link repos to Atlassian / Figma / GitLab items (--watch to keep refreshing)
embed Build semantic-search vectors (zero-config built-in CPU model, Ollama, or an API; incremental, --watch)
ingest Aggregate external docs into the graph + semantic store (built-in files/web/api/mcp sources, or plugins)
wiki [<repo>…] LLM-synthesized, council-verified wiki pages (all repos, or just the named ones); --llm builtin|ollama|openai enables the LLM tier inline
query Search the index (--kind, --repo, --as-of <commit>)
owners Likely owners / SMEs for a repo (or --path), ranked from git history
impact Change-impact / blast radius: what depends on a symbol (--hops, --repo to disambiguate)
graph Visualize the graph, offline interactive HTML / DOT / Mermaid / JSON
dashboard Local knowledge-system dashboard UI (--serve; --site DIR for a static offline export)
serve Expose the graph over MCP (--transport stdio/http)
steer Write editor steering, AGENTS.md, .mcp.json, .windsurfrules, skills
lint · doctor · eval Graph health · environment check · retrieval-quality scoring

Global options apply to any command: --dry-run (preview without changing anything), -v/-q (verbosity), --log-file PATH, --config PATH, --version. Output is colorized on a TTY and plain when piped; set NO_COLOR to force-disable.

Knowledge layer

Beyond mirroring, the optional contextlake.kb layer turns your repos into a knowledge graph and serves it to AI tools over MCP. It can link repos to their Atlassian / Figma / GitLab items, add semantic search, write a curated wiki, visualize the graph (offline interactive HTML, fleet overview, a symbol's neighbourhood, or a single repo), and generate per-tool steering files + a skills library. Most of it needs no model; the rest works with a local Ollama or any OpenAI-compatible endpoint.

One command sets it all up:

contextlake bootstrap --kb-config ~/.contextlake/kb.toml

Full guide: docs/knowledge-layer.md.

The dashboard

contextlake dashboard --serve opens a local, offline-first window into everything the knowledge layer builds — a fleet overview, per-repo anatomy, the cross-repo architecture graph, change-impact (blast radius), health, and search. Try it with zero setup via contextlake dashboard --serve --sample.

The contextlake dashboard fleet overview: stat cards, a knowledge-confidence bar, and repos grouped by namespace, with a Cards/List/Table layout switcher.

→ The dashboard, a guided tour — step by step, with screenshots.

Documentation

License

MIT, see LICENSE. Pebble the otter is the project mascot; deep context, clear answers.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

contextlake-2.20.1.tar.gz (414.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

contextlake-2.20.1-py3-none-any.whl (422.3 kB view details)

Uploaded Python 3

File details

Details for the file contextlake-2.20.1.tar.gz.

File metadata

  • Download URL: contextlake-2.20.1.tar.gz
  • Upload date:
  • Size: 414.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for contextlake-2.20.1.tar.gz
Algorithm Hash digest
SHA256 7e1830e3882b64068574d89b99a4c49cd49dc6dff0f005c4ac178ac27f66d2c6
MD5 4bcf93c36c0f8a28ae0f37ff9bf590ce
BLAKE2b-256 2ebbe4c5629c972d521fd9179c6ed4ea9b6b9e7bb0d0f9d64f97b1fb6cdb4cbf

See more details on using hashes here.

Provenance

The following attestation bundles were made for contextlake-2.20.1.tar.gz:

Publisher: release.yml on sayak-sarkar/contextlake

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file contextlake-2.20.1-py3-none-any.whl.

File metadata

  • Download URL: contextlake-2.20.1-py3-none-any.whl
  • Upload date:
  • Size: 422.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for contextlake-2.20.1-py3-none-any.whl
Algorithm Hash digest
SHA256 54fbd4eed393b5843c9502b5269d0a106960a908631a440549a07c5c06033f40
MD5 002832862efb2a84d6d2dc54f36772f8
BLAKE2b-256 f561416219ed655ad5de301a5941576ff3be0e5d58923080c58e7507c4fbfde5

See more details on using hashes here.

Provenance

The following attestation bundles were made for contextlake-2.20.1-py3-none-any.whl:

Publisher: release.yml on sayak-sarkar/contextlake

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page