Skip to main content

Write-time verification for AI-generated code

Project description

Plumbline

Write-time intelligence for AI-generated code.

Plumbline is an MCP server that makes AI coding agents work against your project's reality — not their priors. It injects project knowledge before the agent writes, runs mutation testing before you commit, and keeps multi-step work from going off the rails.

One install. One server. Eight tools. One spotter hook.

pip install plumbline-ai[all]

What it does

Problem Tool What happens
AI doesn't understand your project plumbline_context Injects conventions, pitfalls, and patterns from your git history
AI forgets related files /btw hook Before every Write/Edit, tells the agent which files usually change together
AI commits untested mutations plumbline_verify Runs mutation testing on staged changes before commit
AI gets sloppy on task 5 of 10 plumbline_advance Evidence gates force discipline across every task

Quick start

Add to your .mcp.json:

{
  "mcpServers": {
    "plumbline": {
      "command": "plumbline-mcp"
    }
  }
}

Or run plumbline setup for guided configuration including the /btw hook.

Tools

Context (know your project)

  • plumbline_context — Project intelligence at session start. Conventions, pitfalls, decisions, hot files.
  • plumbline_query — Search project knowledge mid-task.
  • plumbline_co_changes — Files that change together. Read them before you edit.

Verify (catch mistakes)

  • plumbline_verify — Pre-commit mutation testing on staged changes. Reports surviving mutants as questions: "Your code still passes tests if X is changed to Y. Is that intentional?"
  • plumbline_explain — Understand a finding in detail.

Gate (stay disciplined)

  • plumbline_init — Start tracking a development plan.
  • plumbline_advance — Move through phase gates with evidence. The gate validates your evidence is real, not bare assertions.
  • plumbline_status — Check where you are.

The /btw hook

Plumbline includes a spotter hook that fires before every file write. It doesn't wait for the agent to ask for help — it injects relevant context when the agent is about to edit a file.

/btw — src/auth.py usually changes with:
  - tests/test_auth.py
  - middleware/session.py
Did you read these before editing?

The agent never asked. The spotter saw what was happening and briefed it.

v0.1.0 ships at INFORM level — the hook injects context but does not block writes. GATE level — pre-write blocking via mutation analysis of the proposed content — ships in v0.2.0.

Health check

plumbline doctor

Shows which engines are installed and healthy.

Architecture

Plumbline wraps three proven engines under one surface:

  • Context — powered by Sentinel (project intelligence from git history)
  • Verify — powered by Seraph (mutation testing, static analysis)
  • Gate — powered by Morpheus (plan state, phase gates, evidence validation)

Each engine is optional — install what you need:

pip install plumbline-ai[context]    # just project intelligence
pip install plumbline-ai[verify]     # just code verification
pip install plumbline-ai[gate]       # just plan enforcement
pip install plumbline-ai[all]        # everything

Why

AI coding agents skip optional quality checks every time. Not sometimes — every time. We measured this across 49 tool invocations, 9 controlled experiments, and 5 production projects.

Advisory feedback (letter grades, suggestions, warnings) has a 0% action rate. Blocking gates have a ~100% action rate.

Plumbline doesn't advise. It enforces — through evidence-gated task advancement, mutation-based commit verification, and write-time context injection.

Roadmap

v0.1.0 (current): 8 MCP tools + /btw INFORM hook. Pre-commit verification. Plan-state gating. Project intelligence injection.

v0.2.0: plumbline_check returns — pre-write blocking via the /btw hook automatically running mutation analysis on proposed file content before the Write/Edit tool call completes.

v0.3.0: Debrief loop — post-session /plumbline:debrief skill that interviews the agent and feeds hook tuning back into the signal-to-noise optimizer.

License

MIT.

Built by Evolving Intelligence AI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

plumbline_ai-0.1.1.tar.gz (14.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

plumbline_ai-0.1.1-py3-none-any.whl (16.1 kB view details)

Uploaded Python 3

File details

Details for the file plumbline_ai-0.1.1.tar.gz.

File metadata

  • Download URL: plumbline_ai-0.1.1.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for plumbline_ai-0.1.1.tar.gz
Algorithm Hash digest
SHA256 dfe3cde2e981efaedf036b33f2587773d0a7183444f071f8de8daf261a007f49
MD5 ee530c09ed733def578f190b2e90585a
BLAKE2b-256 efe392928e7136063a345a7149c2243d281ee8b09899ad9853094cf72b2c56ed

See more details on using hashes here.

File details

Details for the file plumbline_ai-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: plumbline_ai-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 16.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for plumbline_ai-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d68763cfef1fddb3215c5e1b7549340551790898ebbd6dceb0802cd482cf75c4
MD5 c5c68f91f794bd30556c8327242f514e
BLAKE2b-256 2a47b843582c3986ebb824fba983db7c58a4776c2bc371289101a1670b2b6a49

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page