Skip to main content

MdBind — Structured memory in plain Markdown

Project description

MdBind

Structured memory in plain Markdown.

Transform your Markdown files into a navigable knowledge graph —
without databases, embeddings, or proprietary formats.

Python Tests Version License PyPI


# Install
pipx install mdbind

# Validate your docs folder
mdb validate --root docs/

# Get a section by URI
mdb get docs/intro.md#intro --json

What is MdBind?

MdBind turns Markdown files into a directed knowledge graph where every section is an addressable node with stable identity, metadata, and explicit relationships.

Your files stay plain text, Git-friendly, and human-readable — but gain:

  • Graph traversal and dependency resolution
  • Stable URIs that survive reorganization
  • Structured metadata queries
  • AI-oriented context retrieval with bounded token consumption

Why not embeddings?

Approach Inspectable Versionable Deterministic Human-readable
Vector databases
Proprietary stores partial partial
MdBind

Every node, every edge, every relationship is visible in the source file. What an agent reads, a human can audit.


Installation

To run mdbind globally as a standalone CLI tool without polluting your system Python packages, use pipx:

# Install the stable version from PyPI
pipx install mdbind

# Or install the latest development version directly from GitHub
pipx install git+https://github.com/gresendesa/mdbind.git

Quick start

To start using mdbind in your project:

# 1. Point it at your docs folder
mdb validate --root docs/

# 2. Query the graph
mdb get docs/auth.md#auth --json

See it in action

# Navigate the dependency tree
$ mdb tree docs/auth.md#auth --root docs/

auth  [docs/auth.md]
├── jwt          [include]  docs/security.md#jwt
└── permissions  [ref]      docs/users.md#permissions

# Compose a unified document by expanding all @include directives
$ mdb compose docs/auth.md#auth --root docs/ --depth 2

# Find everything that depends on a node (reverse BFS)
$ mdb impact docs/auth.md#auth --root docs/ --json

# Boolean metadata query
$ mdb query "tag:api AND NOT status=obsolete" --root docs/ --json

# Bounded context for LLM consumption
$ mdb context-compose docs/auth.md#auth --root docs/ --depth 2 --token-limit 2000 --json

Syntax

Declaring a section

A section is a Markdown heading followed immediately by a YAML block with a section: field:

## Authentication

```yaml
section: auth
title: Authentication
type: domain
owner: security-team
tags: [auth, core]
```

Authentication is responsible for user identity.

[@include: JWT handling](security.md#jwt)

See also: [@ref: permissions model](users.md#permissions)
  • The YAML block must be the first element after the heading
  • section: is mandatory and must be unique per repository
  • Any additional fields are preserved as queryable metadata

Optional schema validation

A section can opt into deterministic metadata validation by adding a schema field to its YAML block. The schema reference is local-first and resolved relative to the Markdown file that contains the section. A colocated schema/ directory is the recommended default; centralized schema directories can still be referenced with normal relative paths.

## Authentication

```yaml
section: auth
schema: schema/domain.schema.json
status: active
owner:
  team: security
```

Schemas are JSON Schema documents. They may be stored as .json, or as YAML when the YAML file encodes the same JSON Schema object. Validation is per-section only: there is no global repository schema, and sections without schema keep the existing free-form metadata behavior.

Directives (graph edges)

[@include: label](path/to/file.md#section-id)   <!-- expands inline during compose -->
[@ref: label](path/to/file.md#section-id)        <!-- records dependency, no expansion -->

Directives are standard Markdown links — they render correctly in any Markdown viewer.

auth
├── jwt          [include]
└── permissions  [ref]

Commands

Quick reference

Command Description
mdb get <URI> Extract a section with full documentary fidelity
mdb tree <URI> Visual dependency hierarchy
mdb compose <URI> Materialize a unified document (expands @include)
mdb validate Check integrity: broken refs, cycles, duplicate IDs, local section schemas, and template minimum conformity
mdb context <URI> Metadata + immediate 1-hop neighborhood
mdb metadata get/update/unset <URI> Read or edit structured YAML metadata
mdb backlinks <URI> All sections that reference this URI
mdb search <predicate> Search sections by metadata
mdb impact <URI> All nodes that depend on this URI (reverse BFS)
mdb neighbors <URI> All nodes reachable within N hops
mdb explain <URI_A> <URI_B> All directed paths between two nodes
mdb diff Structural graph diff against a git reference
mdb query <expression> Boolean metadata/structure query (AND, OR, NOT)
mdb context-compose <URI> Bounded materialization for LLM consumption
mdb pack <dir> Pack template scaffolding into deterministic signed zip package
mdb init Initialize project workspace/memory from signed zip package
mdb check-session-hook Verify agent session rules hook configuration and display secret canary phrase
mdb session-hook Command group to inject or remove agent session instruction rules hooks

All commands accept --json for machine-readable output.
All outputs are deterministic and JSON-serializable. All URIs are stable across sessions.

Selected examples

# Validate an entire repository
mdb validate --root docs/ --json

# Validate template minimum conformity (checks for CONSTITUTION.md and reachability of all .md files)
mdb validate --root my_template_workspace/

# Validate one Markdown file in isolation
mdb validate --file docs/auth.md --json

# Single-file mode skips ordinary broken-ref errors for refs/includes that
# point to other files; use --root when validating the full project graph.

# Validate section metadata against local per-section schemas
mdb validate --root . --json

# 1-hop neighborhood of a node
mdb context docs/auth.md#auth --root docs/ --json

# Read and edit structured YAML metadata without touching the Markdown body
mdb metadata get docs/auth.md#auth owner.name --json
mdb metadata update docs/auth.md#auth status '"review"' --json
mdb metadata update docs/auth.md#auth owner '{"name":"Alice","team":"security"}' --json
mdb metadata unset docs/auth.md#auth draft_notes --json

# Find all sections tagged api that are not obsolete
mdb query "tag:api AND NOT status=obsolete" --root docs/ --json

# Find backlog-like section IDs with a regex predicate
mdb query "section~=/^backlog\\.item\\.B-\\d{3}$/ AND NOT status=done" --root docs/ --json

# Bounded context for LLM — depth 2, max 2000 tokens
mdb context-compose docs/auth.md#auth --root docs/ --depth 2 --token-limit 2000 --json

# What changed structurally since the last commit?
mdb diff --root docs/ --since HEAD~1 --json

# Pack a template directory (e.g. the default scrum template, or kanban/product/engineering/minimal)
mdb pack templates/default -o scrum_template.zip
mdb pack templates/kanban -o kanban_template.zip

# Initialize a workspace memory using a local template zip
mdb init -t scrum_template.zip -r my_new_project/ --var project_name="My New App" --var owner="Bob"

# Pre-bundled template packages in the repository:
# - templates/default: Full Scrum/Sprint agile memory foundation
# - templates/kanban: Continuous delivery flow-based board, decisions, and lessons learned
# - templates/product: Product-driven pitches and cycle specifications (Shape Up style)
# - templates/engineering: Architecture Decision Records (ADR) and roadmap log
# - templates/minimal: Low-friction, lightweight to-do checklist and changelog

# Initialize a workspace memory using a remote web-based template package (requires --checksum)
mdb init -t https://example.com/templates/scrum.zip -r my_new_project/ --checksum d8f2a...f7c22 --var project_name="My New App" --var owner="Bob"

# Validate using web-based schemas and bypassing local cache
mdb validate --root docs/ --no-cache

# Verify agent instruction hooks and retrieve the secret verification phrase
mdb check-session-hook --root my_new_project/

# Inject a hook into a custom agent instructions file
mdb session-hook inject --root my_new_project/ --file .cursorrules --placement top --secret "apple banana orange grape pear"

# Remove all injected hooks from target files in the workspace
mdb session-hook remove --root my_new_project/

[!NOTE] Workspace Configuration & Rationale: mdb init writes project configuration into .mdb/config.yaml at the root of the target directory. Keeping configuration at the repository root serves as a marker for mdbind tool operations, stores global variables, enables commands to locate the repository root automatically, and utilizes a dedicated .mdb/ directory to prevent cluttering the root folder while accommodating future local caches (e.g. cached remote schemas and templates in .mdb/cache/).

Context Anchoring

To prevent AI agents (like GitHub Copilot, Cursor, or custom IDE agents) from operating purely on generic pre-trained parametric memory, MdBind implements Context Anchoring.

Context Anchoring works by injecting instruction rules hooks directly into development environment entrypoints (such as AGENTS.md or .github/copilot-instructions.md). These hooks force the AI agent to load the repository's local non-parametric memory (namely the CONSTITUTION.md and Scrum files) before executing any tasks.

The Alignment Flow

sequenceDiagram
    autonumber
    actor Developer
    participant Agent as AI Agent (IDE/CLI)
    participant Hook as Session Hook (e.g. AGENTS.md)
    participant Memory as Project Memory (CONSTITUTION.md)

    Developer->>Hook: Injects hook (mdb session-hook inject)
    Note over Hook: Registers canary & constitution include
    Agent->>Hook: Starts workspace session & reads instructions
    Hook-->>Agent: Forces context alignment with @include CONSTITUTION.md & canary phrase
    Agent->>Memory: Reads stable URIs, rules, and backlog
    Agent->>Developer: Confirms/challenges using secret canary phrase

Canary Phrase Verification

During initialization or injection, a randomized 5-word secret phrase is stored in the workspace configuration .mdb/config.yaml (under the context_anchoring key).

  1. The injection command writes this canary phrase directly inside the hook boundaries of the instruction files.
  2. When the AI agent initializes its session, it reads the instruction file and must locate the canary phrase.
  3. The developer can run mdb check-session-hook at any time to verify hook health and display the expected canary phrase. If the agent fails to report or acknowledge this phrase, it indicates the agent is not reading the active workspace memory files.

Philosophy

Five principles behind every design decision:

  1. Markdown is the source of truth — no proprietary formats, no hidden state
  2. Knowledge should be inspectable — every node, every edge, every relationship is visible in the source
  3. Relationships should be explicit@include and @ref are first-class graph primitives
  4. Stable identifiers are better than headingsfile.md#id survives reorganization
  5. AI memory should remain human-readable — what an agent reads, a human can audit

Examples

See the examples/ directory for a complete working knowledge base demonstrating sections, directives, composition, and graph traversal.


Development

# Install in editable mode
pip install -e .

# Run the full test suite
python -m pytest

# Run a specific module
python -m pytest tests/test_cli_validate.py -v

263 tests, 0 failures.


License

Apache License, Version 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mdbind-0.1.17.tar.gz (108.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mdbind-0.1.17-py3-none-any.whl (106.1 kB view details)

Uploaded Python 3

File details

Details for the file mdbind-0.1.17.tar.gz.

File metadata

  • Download URL: mdbind-0.1.17.tar.gz
  • Upload date:
  • Size: 108.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for mdbind-0.1.17.tar.gz
Algorithm Hash digest
SHA256 1ba9f3305c893403f7fd7c2beaa5f80a6322bff5fc85b36a6042de298df270c9
MD5 d2d7940660b2f685639cf56ee100d25a
BLAKE2b-256 38b7d0379ca82c5407a3acc454c8b24a4c7d8add7636580884547908e887e6b6

See more details on using hashes here.

File details

Details for the file mdbind-0.1.17-py3-none-any.whl.

File metadata

  • Download URL: mdbind-0.1.17-py3-none-any.whl
  • Upload date:
  • Size: 106.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for mdbind-0.1.17-py3-none-any.whl
Algorithm Hash digest
SHA256 d69f521ccd479372df80bbc86401ff4f59edbf42408bdd588ce5718b766c011f
MD5 ecdecf27d9f08f112c1e5fc31204c7c8
BLAKE2b-256 002581751d6bc7291034a8e35212846bc55b8c872850f0d94bc0c251c6705795

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page