Skip to main content

Droste

An expanding code space. A fixed token window.

Search your local code graph, then zoom from a map to structure and source. The new explore interface keeps its entire response inside a measured token budget, including metadata, and reuses unchanged views the client still retains. Find definitions, inspect static references and verify source freshness.

Local-first · progressive zoom · measured tokens · CLI + MCP

PyPI Python CI License: MIT

Droste token zoom on real Requests source

Explore the recorded token zoom demo, including exact payloads. Original galaxy flythrough (FastAPI)

Token zoom demo · Code galaxy · Quickstart · Exploration · MCP


Quickstart

Install v1.3.0 from PyPI or GitHub Releases. See release status.

# Windows
python -m pip install --upgrade droste-memory

# macOS / Linux
python3 -m pip install --upgrade droste-memory

droste index . # index the current repo
droste view    # open the fractal galaxy in your browser

Install once, then index and view. droste view opens a full-screen, zoomable map of your code — scroll to dive from the project star into folder orbits, down to the individual functions and their indexed relationships.

Need it for an agent instead of your eyes?

droste explore "checkout flow" --tokens 1500

Use returned node IDs as --focus and choose --level map, structure or source to navigate the same region at different detail. used measures the complete compact response under the selected tokenizer. Source bodies downgrade explicitly when they cannot fit. Prepare the small token vocabularies once with droste explore --prepare-tokenizers for later offline use. See the workflow, receipts and measured limits. The older droste context --budget interface still budgets characters.

For everyday code investigation:

droste check                         # verify source hashes and index coverage
droste find calculate                # find symbol IDs, paths and line numbers
droste references calculate --direction both
droste references helper --file src/math.py --direction callers --depth 3
droste watch .                       # refresh after additions, edits, renames or deletions

references returns candidates for ambiguous names; choose a file or symbol ID instead of guessing. Python links include the call expression and source line. Other language links report their heuristic resolution method. check exits with status 1 for stale, partial or unverifiable indexes. Context responses warn about stale/partial coverage using a quick size/mtime check; check additionally verifies SHA-256 hashes. Run it before relying on an old index.

Indexing respects nested .gitignore rules and a project-root .drosteignore (Git ignore syntax; applied last). Symlinks, generated bundles, dependency directories and Droste's own storage are excluded. Use an explicit --db per project when running independent writers. watch batches root refreshes and reuses unchanged extraction/embeddings; view remains a snapshot, so reopen it to see a refreshed graph.

Running droste with no arguments prints the command palette:

                  .-----------------------.
             .----'           |           '----.
         .---'          .-----+-----.          '---.
       .'          .----'     |     '----.          '.
      /        .---'      .---+---.      '---.        \
     /      .-'        .-'    |    '-.        '-.      \
    |     .'        .-'   .---+---.   '-.        '.     |
    |    /        .'    .'    |    '.    '.        \    |
    |   |        |     |   .--+--.   |     |        |   |
    | --+--------+-----+---+  @  +---+-----+--------+-- |
    |   |        |     |   '--+--'   |     |        |   |
    |    \        '.    '.    |    .'    .'        /    |
    |     '.        '-.   '---+---'   .-'        .'     |
     \      '-.        '-.    |    .-'        .-'      /
      \        '---.      '---+---'      .---'        /
       '.          '----.     |     .----'          .'
         '---.          '-----+-----'          .---'
             '----.           |           .----'
                  '-----------------------'

DROSTE-MEMORY // RIGID FRACTAL RADIAL LAYOUT
Local Graph Engine v1.3.0-Alpha-Sharded

Commands
  droste index <path> [--reset]
  droste status
  droste zoom <symbol_name>
  droste context [query] --budget 1500
  droste mcp

Fast path: droste context hub_core --budget 1000 | clip

Why it's different

Droste combines lexical and semantic retrieval with a static code graph and an interactive map. A graph can bring callers and callees into context even when they share few words with the query. Other tools also offer graph-based MCP retrieval; see the dated ecosystem review.

Droste focuses on a small Python CLI, budgeted context, and visual exploration. The graph is a static approximation: name matching and cross-language bridges can produce false positives and do not prove runtime behavior.

The useful building blocks are:

  • Explainable static references. Python calls use lexical scopes, import aliases and explicit self/cls members. Dynamic receivers remain unresolved. Other languages use local/unique-name matching; ambiguous candidates are skipped.
  • Cross-language bridges. Droste links across languages — app code to SQL functions/tables (.rpc('x'), .from('table')), to edge functions, and same-name handlers between any two languages. Your Dart/TS/Python frontend and your database stop being two separate worlds on the map.
  • Visual exploration. Navigate files, symbols and indexed relationships in an interactive radial map.
  • Zero-config and local. No cloud, no account, no API key. fastembed (ONNX, no torch) gives real semantics; a deterministic fallback keeps it runnable anywhere.

Polyglot: Python (AST) + tree-sitter for Dart, TypeScript/JavaScript, Go, Rust, Java, C#, C/C++, Kotlin, Swift, Ruby, PHP, SQL — symbols and edges.

Honest scope: the measured advantage is structural / causal retrieval. On pure semantic "concept" queries it's competitive with a vector baseline, not a leap. Cross-language bridges are strongest where the target is actually defined in the indexed repo (e.g. SQL schema in your migrations).


Benchmarks

The public source validation uses pinned Requests and CPython revisions with manually labelled edge assertions. It currently passes 19 of 20 assertions: 15/16 expected edges found, 0/4 forbidden edges emitted. The missed edge is documented; this small corpus is not an agent-task benchmark or a comparison against competing products.

python eval/public_corpus.py --output public-results.json

The evaluation script compares structural retrieval against lexical and vector baselines, using caller/callee relations extracted from the same code as the reference. This measures graph-neighbor retrieval, not agent task completion or superiority over another product. Previous headline numbers are omitted until we publish a fixed public corpus, pinned revisions and complete result files.

python eval/comparative_eval.py --repos /path/to/public/repo --sample 60 --seed 7 --json results.json

Use the real embedding backend for semantic comparisons; the offline hash mode is deterministic but does not provide semantic similarity.


How it works

  • Static graph. Python scopes and imports resolve named calls; tree-sitter supplies definitions/references for other supported languages. Their name-based links and cross-language DB/string bridges are heuristics, labelled in reference results. No runtime behavior or complete type resolution is implied.
  • Hybrid seed. A query is matched by a normalized blend of lexical score and semantic cosine (fastembed bge-small-en-v1.5, 384-dim), then the graph expands the seed bidirectionally (callees and callers).
  • Context packer. The budget is characters, with a minimum of 500. Full source, contracts or explicit source stubs fit that effective limit, including separators. No tokenizer-specific token count is promised.
  • Sharded persistence. One shard per file under a database-specific .droste/ directory, blake2b dirty-tracking so a re-index rewrites only what changed; atomic file replacement with metadata written last. Multi-file updates are not transactions; use one writer per DB and re-index after an interrupted write.

Use it as an MCP server

Droste is a drop-in MCP server — an AI agent can call it as primary code memory instead of doing blind file reads. Add this to your client configuration file (e.g., Cursor, Claude Desktop, or Codex):

First install or upgrade to the current PyPI release:

# Windows
python -m pip install --upgrade droste-memory

# macOS / Linux
python3 -m pip install --upgrade droste-memory

droste mcp --help

For Codex, add this to C:\Users\<you>\.codex\config.toml on Windows, or ~/.codex/config.toml on macOS/Linux:

[mcp_servers.droste]
command = "droste"
args = ["mcp"]
startup_timeout_sec = 120

Installed packages store their default database in %LOCALAPPDATA%/Droste on Windows, ~/Library/Application Support/Droste on macOS, or ${XDG_DATA_HOME:-~/.local/share}/droste on Linux. Source checkouts preserve their repository-local database. Set DROSTE_DB or pass --db to override. Existing databases inside an older installation are not moved automatically; point --db at the old file to continue using it, or re-index your source.

For explicitly offline operation, set DROSTE_EMBEDDING_BACKEND=hash. The default auto backend may download an embedding model on first use; code is processed locally. Hash mode trades semantic retrieval for deterministic, network-free embedding. droste view serves a snapshot; rerun it after indexing.

By default, droste mcp uses Droste's global local database. That is fine for quick use and small workflows. For serious multi-repo work, use one database per repository so each project has isolated memory and agents can safely re-index that project with reset=true.

The --db option is global, so keep it before mcp:

# Windows example
[mcp_servers.droste]
command = "droste"
args = ["--db", "C:/Users/you/AppData/Local/Droste/my-project/droste_memory_db.json", "mcp"]
startup_timeout_sec = 120
# macOS / Linux example
[mcp_servers.droste]
command = "droste"
args = ["--db", "/Users/you/.local/share/droste/my-project/droste_memory_db.json", "mcp"]
startup_timeout_sec = 120

For JSON-based MCP clients:

{
  "mcpServers": {
    "droste": {
      "command": "droste",
      "args": ["mcp"]
    }
  }
}

The same isolated-DB pattern works in JSON clients:

{
  "mcpServers": {
    "droste": {
      "command": "droste",
      "args": [
        "--db",
        "/absolute/path/to/droste_memory_db.json",
        "mcp"
      ]
    }
  }
}

Restart your client after changing the MCP config. Index the project, call droste_check_index, then use symbol lookup and references before retrieving context. Inspect the real source before making changes.

Primary tools: droste_index_project, droste_check_index, droste_find_symbols, droste_references, droste_get_context, droste_status. Supporting canvas tools: inject_concept, move_camera_and_zoom, get_space_status.


Use it as an agent skill

Droste also ships agent skill templates for Codex and Claude. They teach an agent how to use Droste safely: isolated DBs, indexing, droste context, MCP config, and root-contamination guardrails.

Codex skill:

integrations/codex-skill/droste-code-memory/

Claude-compatible skill:

integrations/claude-skill/droste-code-memory/

Install the Codex skill by copying the folder into your Codex skills directory:

# macOS / Linux
mkdir -p ~/.codex/skills
cp -R integrations/codex-skill/droste-code-memory ~/.codex/skills/
# Windows PowerShell
New-Item -ItemType Directory -Force "$env:USERPROFILE\.codex\skills" | Out-Null
Copy-Item -Recurse -Force integrations\codex-skill\droste-code-memory "$env:USERPROFILE\.codex\skills\"

Then ask Codex:

Use $droste-code-memory to index this repository and retrieve causal context before editing.

For Claude, import or copy the Claude skill folder as a Claude Skill package and keep its SKILL.md, references/, and scripts/ together.


Development

pip install -e ".[dev]"
pytest                            # deterministic regression suite (tests/)
python eval/comparative_eval.py   # retrieval benchmark vs lexical & vector cores

tests/ = invariants + concurrency (round-trip, dirty-oracle, packer guardrail, cross-process shard race). eval/ = performance/quality benchmarks.


Status

v1.3.0 (alpha). Progressive token-budget exploration, tested CLI/MCP workflows, source freshness checks and an explicitly limited static graph. Dynamic dispatch, receiver-type inference and complete cross-language resolution remain outside the current guarantees. Use one writer per database. See validation and limitations.

What's new in v1.3.0

  • Search and zoom map → structure → source with droste explore and droste_explore.
  • Bound the complete response with real o200k_base / cl100k_base token counts.
  • Reuse exact unchanged views only when the client acknowledges it still retains them.
  • Verify source hashes before navigation and expose downgraded detail and omissions.
  • Add a recorded interactive demo, exact public responses and installed-wheel checks of the tenth MCP tool.

What's new in v1.2.1

  • Keep explicit, unique symbol queries ahead of semantic lookalikes.
  • Preserve complete source locations in compact context.
  • Publish a practical Requests investigation, including unresolved discovery and tracing weaknesses; no comparative performance claim.

What's new in v1.2.0

  • Fix Python scope/import resolution and stop guessing ambiguous name matches.
  • Add find, references, check and matching MCP tools, with source evidence.
  • Refresh all supported languages after edits, additions, deletions and renames.
  • Report partial coverage and stale context; preserve other roots during --reset.
  • Respect ignore rules and actually collect Java, C#, Ruby and PHP files.
  • Separate cached embeddings by model identity and rebuild when switching backends.
  • Add independent public-source assertions and exercise all nine MCP tools.

What's new in v1.1.7

  • Restored fresh-install MCP startup by requiring the compatible 1.x SDK.
  • Restored polyglot syntax edges with the current tree-sitter Python API.
  • Fixed droste --db ... view to visualize the requested database.
  • Viewer snapshots use temporary storage, including with read-only installations.
  • Isolated shards, registries and embedding caches for databases sharing a folder.
  • Installed packages use writable user data storage; DROSTE_DB overrides it.
  • Added Windows CI, wheel-content checks and an installed CLI/viewer/MCP smoke test.
  • Restored the demo homepage and refreshed the competitive positioning.

What's new in v1.1.6

  • Fixed the PyPI wheel packaging for droste view by shipping the visualizer HTML/templates and public demo graph inside the installed package.
  • Verified the three-command pitch from a clean install: pip install droste-memory, droste index ., droste view.

What's new in v1.1.5

  • Fixed self-index contamination by excluding Droste's own .droste/, .tmp/, and *.egg-info directories from project scans.
  • Improved small-budget context packing by pinning the focus node's direct callers/callees before secondary lexical matches.
  • Guaranteed compact stubs for true causal neighbours so important wormholes do not disappear when full context cannot fit.

What's new in v1.1.4

  • Fixed Python 3.10/3.11 compatibility by replacing Python 3.12-only Path.walk() usage.
  • Hardened MCP Registry publishing so metadata is only published after the matching PyPI release is live.
  • Improved CI diagnostics for faster multi-version release debugging.

What's new in v1.1.3

  • Added public Codex and Claude skill templates for agent-side Droste adoption.

What's new in v1.1.2

  • Added MCP Registry ownership metadata in the README/PyPI description.
  • Added server.json for official MCP Registry publishing.
  • Added manual and scheduled growth workflows for MCP registry publishing and visibility checks.

What's new in v1.1.1

  • Packaging/privacy hardening: generated visualizer JSON files (graph.json, status.json, context.json) are excluded from source distributions, while the public visualizer/demo_graph.json remains included.

What's new in v1.1.0

  • MCP context is root-isolated: droste_index_project records the active repo, and droste_get_context / droste_status filter to that root unless an agent passes another root explicitly.
  • Multi-root databases no longer silently mix repositories when no safe root can be inferred; Droste returns a clean warning instead.
  • Windows CLI output is guarded for UTF-8 consoles to avoid UnicodeEncodeError crashes on older terminal encodings.
  • Retrieval ranking is now query-aware: runtime code gets a slight boost for normal implementation queries, while tests/docs remain fully visible when the query asks for them.

License

MIT — see LICENSE.

Metadata

Release files for droste-memory 1.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for droste-memory 1.3.0
File Size Uploaded
droste_memory-1.3.0.tar.gz 172.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for droste-memory 1.3.0
File Interpreter ABI Platform
droste_memory-1.3.0-py3-none-any.whl Python 3 none any Details

Total release size: 321.8 kB

Release files / droste_memory-1.3.0.tar.gz

Download URL droste_memory-1.3.0.tar.gz
Size 172.1 kB
Tags Source
SHA-256 checksum
How to use checksums
e13a3aa58638f3b56d7bf0bc3f2823a90ad6f42c0379081a9b137b118be276f7
BLAKE2b-256 checksum
How to use checksums
12f1be25d44edffd390e6d72c4bcaf64e67d0884a38ece6ff0a44297c124f557
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Release files / droste_memory-1.3.0-py3-none-any.whl

Download URL droste_memory-1.3.0-py3-none-any.whl
Size 149.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b37215376623f5a6d4ccf93c0fbf7f5a5fd60b5d791ca76adfbc4757bcfbdb22
BLAKE2b-256 checksum
How to use checksums
9e0c350b7dfde673d2cbd7ff1f9a604bd81dbc6c67ed36d04a9aa69388d7c8a8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

1.3.0 This release

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.7

2 release files

1.1.6

2 release files

1.1.5

2 release files

1.1.4

2 release files

1.1.3

2 release files

1.1.2

2 release files

1.1.1

2 release files

1.1.0

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page