Skip to main content

Fork of code-review-graph with first-class Terraform support powered by treesitter-tf

Project description

dagayn

DAG is All You Need — a knowledge-graph-centered approach to code review and impact analysis.

dagayn is a fork of code-review-graph focused on practical AI-assisted review for polyglot repositories, especially infrastructure-heavy codebases.

This fork keeps the graph-centered review model from the upstream project, but it is documented and maintained as its own product. The most visible differences are first-class Terraform support, commit-pinned grammar fetching for fork-specific parsing, broader platform-install flows, and a stronger focus on monorepos that mix application code, docs, and infra.

What dagayn does

dagayn parses your repository into a local SQLite knowledge graph. It records files, symbols, references, call edges, imports, test links, communities, and execution flows. AI agents can query that graph instead of re-reading the whole repository on every task.

In practice, that means:

  • smaller review context windows
  • faster impact analysis
  • safer refactors
  • better navigation across large repositories
  • a single workflow for code, docs, notebooks, and Terraform

Fork status

dagayn is explicitly a fork of code-review-graph.

It does not treat upstream documentation as canonical. All project guidance, examples, and command descriptions in this repository are written for dagayn itself.

See NOTICE for upstream attribution and original author information.

Highlights

  • first-class Terraform parsing for .tf and .tfvars
  • Markdown structure and dependency extraction, including directive comments
  • notebook parsing for .ipynb
  • incremental graph updates and watch mode
  • MCP server for AI coding tools
  • graph queries for impact radius, review context, communities, flows, and refactors
  • multi-repo registry and daemon workflows
  • GraphML, Mermaid C4, SVG, Cypher, and Obsidian graph exports

Supported languages and file types

dagayn covers mainstream application languages plus repo-adjacent formats.

Highlights include:

  • Python, JavaScript, TypeScript, TSX, Go, Rust, Java, C#, Ruby, PHP, Kotlin, Swift, Scala, Solidity, Dart, Lua, Luau, Objective-C, Bash, Elixir, Zig, PowerShell, Julia, GDScript, Vue, Svelte, Astro
  • Markdown
  • Jupyter notebooks and Databricks notebook sources/exports as graph inputs
  • Terraform

See docs/FEATURES.md and docs/LLM-OPTIMIZED-REFERENCE.md for the current coverage summary.

Terraform support

dagayn treats Terraform as a first-class language alongside application code. Both .tf and .tfvars files are parsed by a dedicated Tree-sitter grammar.

Parsed block types

Block Qualified-name pattern Graph kind
resource "type" "name" resource.type.name Class
data "type" "name" data.type.name Class
variable "name" var.name Function
locals { key = … } local.key (per attribute) Function
output "name" output.name Function
module "name" module.name Class
provider "name" provider.name Class
terraform {} terraform Class
check "name" check.name Test
ephemeral "type" "name" ephemeral.type.name Class
import {} edges only
moved {} edges only
removed {} edges only

Edge types produced

  • REFERENCES — any var.x, local.x, module.x, output.x, provider.x, data.type.name, or resource_type.name expression inside a block body. The parser extracts these with a dedicated regular expression and skips Terraform built-in prefixes (count, each, path, self, terraform).
  • CALLS — built-in function calls such as merge(…) or length(…).
  • IMPORTS_FROM — the source attribute in module and terraform required_providers blocks, and the target of import blocks.
  • CONTAINS — file to every block defined in it.
  • DEPENDS_ONrequired_providers version constraints in terraform blocks.

Cross-module analysis

When a module block references a local path in source, dagayn records an IMPORTS_FROM edge from the calling module to the target directory. This lets impact-radius queries cross module boundaries.

.tfvars files

Variable value files (.tfvars) are parsed as Terraform. Their top-level attribute assignments become var.name nodes linked to the corresponding variable block in .tf files via REFERENCES edges, giving the graph a complete picture of variable data flow.

Markdown support

dagayn extracts graph nodes and edges from Markdown documentation alongside source code, so prose architecture decisions and code they describe appear in the same graph.

Parsed node types

Element Qualified-name pattern Graph kind
Document file path File
# Heading###### Heading file::slug DocSection
Setext H1 / H2 (underline style) file::slug DocSection
Paragraph/list/table/code body under a heading file::slug--body-N DocBody

Heading slugs follow the GitHub Markdown convention: lowercase, spaces and hyphens collapsed to -, non-alphanumeric characters removed. Duplicate headings within a file get a numeric suffix (slug-1, slug-2, …).

Edge types produced

  • CONTAINS — heading hierarchy. A level-2 heading that appears under a level-1 heading is recorded as a child of that section.
  • REFERENCES — inline or reference-style links between sections: [text](./other.md#heading) or [text](#local-heading). Source is the containing section; target is resolved to file::slug form.
  • IMPORTS_FROM — cross-file links. When a link or directive points to a different Markdown file, an IMPORTS_FROM edge is added from the current file to the target.
  • DEPENDS_ON — directive comments (see below).

Directive comments

Directive comments are HTML comments with a structured form that express inter-document dependencies machine-readably:

<!-- constrained-by ./decisions/adr-001.md#context -->
<!-- blocked-by ./specs/open-issue.md -->
<!-- supersedes ./old-api.md#endpoint-design -->
<!-- derived-from ./research/background.md#findings -->

Supported directive kinds:

Directive Meaning
constrained-by This section's design is constrained by the referenced document or section
blocked-by Implementation is blocked pending the referenced item
supersedes This document replaces the referenced content
derived-from This section is derived from the referenced source

Each directive becomes a DEPENDS_ON edge. The markdown_directive_kind edge attribute records the specific directive type for downstream filtering.

Link resolution

The parser handles:

  • [text](./relative/path.md#section) — resolved relative to the source file
  • [text](#local-section) — resolves to the same file
  • [ref]: path reference-definition style
  • External URLs (http://, https://, mailto:) are ignored

Installation

pip install dagayn

For a persistent isolated CLI environment, uv tool install works too:

uv tool install dagayn

For an isolated one-shot CLI, uvx works well:

uvx --from dagayn dagayn --help

Published wheels include the compiled extension for supported targets, so the normal PyPI install paths do not require building from the Git repository.

If you prefer persistent isolated tool installs, pipx also works.

Quick start

dagayn install
dagayn build
dagayn status

install auto-detects supported AI coding platforms and writes MCP configuration where appropriate. Run without arguments on a TTY to be prompted for one of three embedding modes (see below); under -y or a non-TTY stdin the mode must be passed explicitly.

build creates the initial graph.

Use dagayn build --force-full-build (or --force) when you want to delete the existing graph database before rebuilding from scratch.

status confirms the graph exists and reports basic counts.

Choosing an install mode

dagayn install supports three embedding strategies as first-class options:

# 1. FTS only — no embeddings, fastest, no model download.
dagayn install --mode fts

# 2. Local — managed Qwen3 llama.cpp GGUF sidecar.
dagayn install --mode local --preset low    # Qwen3-Embedding-0.6B (~1 GB)

# 3. Remote — OpenAI-compatible / Google / MiniMax cloud embeddings.
dagayn install --mode remote --provider openai
dagayn install --mode remote --provider google
dagayn install --mode remote --provider minimax

For --mode remote, set the provider's environment variables in the shell that launches your AI coding tool (e.g. CRG_OPENAI_API_KEY, CRG_OPENAI_BASE_URL, CRG_OPENAI_MODEL for openai); the MCP server inherits those at launch time and the generated dagayn serve --remote-embedding <provider> entry makes MCP search use that provider automatically. The exact env-var list is printed at install time. The legacy --local-embedding low flag still works as a shortcut for --mode local --preset low.

Rust backend

The Rust-backed graph store and Rust-owned parser paths are the default for Markdown, Terraform, Rust, Python/notebooks, and Bash/Go/Java/Ruby/C#/PHP/Kotlin/Swift/Scala/Solidity/Dart/Lua/Luau/C/C headers/Perl XS/C++/Objective-C/Elixir/GDScript/R/Julia/Perl/Vue/Svelte/Zig/PowerShell, extensionless shebang scripts for supported scripting languages, plus core JavaScript/JSX/TypeScript/TSX and Astro files:

dagayn build
dagayn update

Source checkouts without the native extension now fail clearly instead of falling back to the removed Python parser implementation.

Common CLI flows

dagayn build
dagayn update
dagayn watch
dagayn detect-changes --base HEAD~1
dagayn visualize --format graphml
dagayn serve

MCP tool surface

dagayn serve exposes every public MCP main tool by default. Workflow-specific analysis is routed through dispatcher tools such as review_tool, flow_tool, and architecture_analysis_tool, so routine sessions no longer need named server profiles.

dagayn serve
dagayn serve --tools query_graph_tool,semantic_search_nodes_tool

--tools is an exact comma-separated allow-list for deployments that need to hide some public tools. Persistent server configs can use CRG_TOOLS for the same control.

Tool responses use a calibrated guidance contract. Compatibility fields such as status, summary, _hints, and next_tool_suggestions remain, while review, architecture, flow, refactor, search, and query responses can also include guidance, answerability, and missingness. Guidance items carry claim, evidence, confidence, missingness, action, reason_codes, and counts so agents can treat graph output as evidence-ranked leads rather than verdicts. Use detail_level="minimal" for the top recommendations and detail_level="standard" for the full supporting sections. query_graph_tool zero-result and not-found responses include zero_result_reason, next_action, result_count, results, answerability, and missingness; treat absence as graph-limited until source or tests confirm it. Documentation bridge results label evidence as authored, extracted, or heuristic_reachable so Markdown traceability is not confused with a verified contract.

Reporting and export outputs

dagayn visualize exports static graph artifacts.

  • --format is required and supports graphml, mermaid-c4, svg, cypher, and obsidian
  • mermaid-c4 emits Mermaid C4Component code with files collapsed into components and cross-file relations
  • svg export uses matplotlib, so install the eval extra when you need it: pip install "dagayn[eval]"
  • Jupyter / Databricks notebooks are parsed as graph inputs, not emitted as report formats

AI platform integration

dagayn install can configure MCP for these targets:

  • Codex
  • Claude / Claude Code
  • Cursor
  • Windsurf
  • Zed
  • Continue
  • OpenCode
  • Antigravity
  • Qwen Code
  • Kiro
  • Qoder
  • Pi
  • Hermes Agent

You can limit installation to a single platform with --platform <name>. For Codex, install also creates global ~/.codex/hooks.json and enables hooks in ~/.codex/config.toml so the graph refreshes during Codex sessions. Claude hooks are written to global ~/.claude/settings.json. Installed git hooks run dagayn update --skip-flows before commit-time checks and a full dagayn update after each commit.

Platform-specific instruction files are also installed where needed:

  • Claude uses ~/.claude/CLAUDE.md
  • Codex uses ~/.codex/AGENTS.md
  • OpenCode uses ~/.config/opencode/AGENTS.md
  • Qoder uses QODER.md
  • --platform qcoder is accepted as an alias for qoder

How the graph is used

A typical review loop looks like this:

  1. build or update the graph
  2. ask for minimal context or a change review
  3. inspect only the affected files and symbols
  4. follow communities, flows, or cross-file references as needed
  5. refresh incrementally after edits

The graph is stored locally under .dagayn/ by default. No external database is required.

Semantic search and embeddings

semantic_search_nodes runs FTS5 BM25 and vector cosine similarity in parallel, then merges both ranked lists via Reciprocal Rank Fusion (RRF). When embeddings are not yet present only the FTS5 arm contributes; when both are available you get hybrid results automatically — no per-search configuration change required. dagayn serve --local-embedding low makes MCP search default to the local llama.cpp GGUF OpenAI-compatible sidecar, and dagayn serve --remote-embedding {openai,google,minimax} makes MCP search default to that remote provider. The FTS index includes generated identifier tokens (so LocalEmbeddingProvider also matches local embedding provider) plus bounded source/document text such as docstrings and Markdown section bodies.

A search_mode field in the response reports which arms contributed: "hybrid" (both), "fts_only", "embedding_only", or "keyword_fallback" (LIKE substring, triggered only when the FTS5 index does not exist). Search results are further ranked by a query-aware kind boost (PascalCase → classes, snake_case → functions) and an optional context-file boost for nodes in files you are currently editing.

Providers

Provider Runs where Install extra Required env vars
local (default) Fully offline dagayn[embeddings] for sentence-transformers local models
openai Cloud or self-hosted gateway CRG_OPENAI_API_KEY, CRG_OPENAI_BASE_URL, CRG_OPENAI_MODEL
google Google Cloud dagayn[google-embeddings] GOOGLE_API_KEY
minimax MiniMax Cloud MINIMAX_API_KEY

The openai provider speaks the standard /v1/embeddings schema, so it works with real OpenAI, Azure OpenAI, LiteLLM, vLLM, LocalAI, Ollama (in OpenAI mode), and similar gateways. When CRG_OPENAI_BASE_URL points to localhost the cloud egress warning is suppressed automatically.

Vector search uses numpy by default for the cosine-similarity matrix path; the embeddings extra is only needed for the built-in sentence-transformers provider.

Installing the local provider

pip install "dagayn[embeddings]"

Running embedding

Call embed_graph_tool via MCP (or let your AI agent call it after build_or_update_graph_tool). Pass provider and optionally model to override the defaults.

embed_graph_tool(provider="local")
embed_graph_tool(provider="openai")   # reads CRG_OPENAI_* from env
embed_graph_tool(provider="google")   # reads GOOGLE_API_KEY from env
embed_graph_tool(provider="minimax")  # reads MINIMAX_API_KEY from env

Embeddings are stored in the embeddings table inside .dagayn/graph.db. Switching provider or model invalidates the cache and triggers a full re-embed on the next call.

Search quality

Measured on the dagayn codebase itself (8,339 graph nodes, 7,947 embedded non-file nodes) with the local low preset. The code-search benchmark uses 12 queries spanning exact function names, PascalCase class names, and conceptual natural-language queries. Latency reflects a query-only run against the existing .dagayn/graph.db; embedding build time is not included.

Code search benchmark

Mode Retrieval path mean MRR Precision@1 Precision@5 Precision@20 avg query latency
FTS5 only lexical 0.5741 0.5000 0.6667 0.8333 0.6 ms
Qwen3-Embedding-0.6B Q8 low embedding only 0.7153 0.6667 0.8333 0.8333 29.6 ms
Hybrid search FTS5 + embedding RRF 0.6806 0.5833 0.9167 0.9167 9.9 ms

Embedding-only is strongest on mean MRR for this mixed query set, while hybrid search keeps FTS exact-name recall and has the best Precision@5/20. On the previous larger-model experiment, the 4B high preset did not beat low and was about 7x slower to embed, so the local preset surface keeps only low.

Documentation search benchmark

The documentation benchmark uses 19 fuzzy natural-language questions against README.md plus docs/, excluding audit/plan notes. Targets use graded relevance across DocSection and DocBody nodes.

Mode Retrieval path mean MRR Precision@1 Precision@5 Precision@20 nDCG@5 nDCG@20 avg query latency
FTS5 only lexical docs 0.4367 0.3158 0.5789 0.8947 0.3375 0.4239 8.8 ms
Qwen3-Embedding-0.6B Q8 low embedding only 0.5017 0.3684 0.5789 0.7895 0.3457 0.4360 35.8 ms
Hybrid search corpus-filtered FTS5 + embedding RRF 0.6546 0.5263 0.7895 0.9474 0.4848 0.5820 23.6 ms

Hybrid search works best for documentation because FTS anchors explicit terms while DocBody embeddings recover paraphrases that do not appear directly in headings or metadata. See docs/LOCAL-EMBEDDINGS.md for local setup and more embedding details.

Privacy and cloud egress

Before sending any data to a cloud provider, dagayn prints a warning to stderr listing what will be transmitted (function names, docstrings, file paths). To acknowledge once and suppress the warning in subsequent runs:

export CRG_ACCEPT_CLOUD_EMBEDDINGS=1

To stay fully offline, use the local provider. No API key or network access is required.

Documentation map

  • docs/USAGE.md — installation and day-to-day workflows
  • docs/COMMANDS.md — CLI, MCP tools, prompts, and exported artifacts
  • docs/FEATURES.md — what the fork emphasizes and where it differs
  • docs/ARCHITECTURE.md — parser, storage, and post-processing pipeline
  • docs/SCHEMA.md — node, edge, and metadata model
  • docs/TROUBLESHOOTING.md — practical fixes
  • docs/LLM-OPTIMIZED-REFERENCE.md — machine-oriented reference sections

Current development direction

The fork currently emphasizes:

  • infra-aware review, especially Terraform
  • mixed-language monorepos
  • stable relative-path graph registration from the repo root
  • MCP-first workflows for terminal and editor agents
  • reproducible local analysis without hosted services

Security and privacy

dagayn is designed around local graph storage. Some optional embedding providers can call remote APIs, but those flows are opt-in and documented separately.

See SECURITY.md and docs/LEGAL.md for details.

Contributing

See CONTRIBUTING.md for development setup, verification commands, and contribution rules.

License

MIT. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dagayn-4.2.2.tar.gz (588.8 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

dagayn-4.2.2-cp314-cp314-manylinux_2_39_x86_64.whl (25.9 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.39+ x86-64

dagayn-4.2.2-cp314-cp314-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.14macOS 11.0+ ARM64

dagayn-4.2.2-cp313-cp313-manylinux_2_39_x86_64.whl (25.9 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.39+ x86-64

dagayn-4.2.2-cp313-cp313-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

dagayn-4.2.2-cp312-cp312-manylinux_2_39_x86_64.whl (25.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.39+ x86-64

dagayn-4.2.2-cp312-cp312-macosx_11_0_arm64.whl (25.8 MB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

File details

Details for the file dagayn-4.2.2.tar.gz.

File metadata

  • Download URL: dagayn-4.2.2.tar.gz
  • Upload date:
  • Size: 588.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for dagayn-4.2.2.tar.gz
Algorithm Hash digest
SHA256 ea26232a4d4548319cd95cdc3d274715dfb0539472dbd02efe21d5b3c0281d51
MD5 670dbc1702fccb4c024811ef2594c3b4
BLAKE2b-256 de6c08eb65e996c4fe235b260838063a144a22091faaed2812dbc46dba9bb0c7

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp314-cp314-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp314-cp314-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 0465c6eac81e13cc9a3c47879b41d071b13806b4200a181d64b7c15dbe27b413
MD5 2763627286d86eac940431e43c7d2084
BLAKE2b-256 987653f7ddcc3d85f5e5a7a99818185b31a1da6ab78b9d7e81ece5b9d7d1bf50

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp314-cp314-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp314-cp314-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 d3c6290fadcf2fc019415d1ffd94ad5b6426f5b111601842537f3d2c50411960
MD5 ef1faf18ad62074162c7bbb188bed8ba
BLAKE2b-256 6853e70a82a7d6f976b0f0f78ffb347cf7f66be49c999b81cf717af404084481

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp313-cp313-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp313-cp313-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 e8a3fd644d9e35d8d079f505d16c25a74738e6b136caa120f6d9065e9cfaafb8
MD5 e8e765a5190689012ebbc8794fda672c
BLAKE2b-256 70e8e06c9965dcfc8f5a1b917f6156e2b3f3bf6a03870c8d0c94b44858c53b9e

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8b82334c25a7d49ef857e5cbbcb2e432118d276a0708544c56cd3038930ff1e5
MD5 f5340908be48dd0661a503f8e18e80cc
BLAKE2b-256 a388931602be84bf887e28549bf6e729ec8488fa99cb671170a9e1d1fc92dffe

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp312-cp312-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp312-cp312-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 99595a121702df63c5c3355647e8eff0a823331a195694628ba9745ab1339d5d
MD5 9bb80efc7968bcb95077aa47290d24be
BLAKE2b-256 d7eea98d6b3126e4a331d847a2e813a605517c776540ab05d71da071656e8ce7

See more details on using hashes here.

File details

Details for the file dagayn-4.2.2-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for dagayn-4.2.2-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 544375af6421fccc37a80ce1da290fb77564cf7c35849b8687d169d2942e4308
MD5 9d17b95a8c93e9792bb13592c1bbf898
BLAKE2b-256 ff3d3ab323a4f81bed97c0a02d6a20d916e088bf8108f2e637e23e3f02c279d3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page