Skip to main content

prove-it-ai-gate

Don't trust agent output. Accept evidence.

CI Python License

A lightweight local CLI acceptance gate for AI-generated engineering work. Checks agent transcripts, evidence folders, workspace state, and validation outputs before accepting AI-generated work.

Warning: This tool checks evidence quality, not absolute correctness. It is not a substitute for human review on high-risk changes.

Project Status

prove-it-ai-gate is currently an early beta.

Stable core:

  • transcript-check
  • workspace-check
  • evidence-check
  • accept

Experimental:

  • reuse-scan
  • capture
  • wiki upload
  • evidence cleanup/archive

Use the stable core for local dogfooding. Treat experimental features as evolving APIs.

Installation

pip install prove-it-ai-gate

Or from source:

git clone https://github.com/hrishikesh-thakre/prove-it-ai-gate.git
cd prove-it-ai-gate
pip install .

Requires Python 3.9+.

Quick Start

ai-gate init
ai-gate transcript-check --transcript transcript.jsonl
ai-gate workspace-check --repo ./my-project
ai-gate evidence-check --evidence ./evidence --task-type audit

# Full acceptance gate
ai-gate accept \
  --repo ./my-project \
  --evidence ./evidence \
  --transcript transcript.jsonl \
  --task-type audit

# Scan a knowledge wiki before starting work (experimental)
ai-gate reuse-scan --brief brief.md --local-wiki ./wiki-exports

# Capture reusable learnings after acceptance (experimental)
ai-gate capture --evidence ./evidence --output ./learnings

Decision States

Decision Meaning
ACCEPT Required evidence exists and checks passed
ACCEPT_WITH_CONDITIONS Mostly acceptable, but follow-ups remain
REJECT Evidence proves a failure or unacceptable risk
BLOCKED Required evidence is missing or invalid

Built-in Checks

Check What it catches
transcript_truncation_check Agent used truncated tool output without replacement evidence
workspace_hygiene_check Agent modified target repo during read-only task, scratch files in repo
evidence_folder_schema_check Missing, empty, or placeholder evidence files
confidence_claim_check Unsupported high-confidence claims, heuristic overclaim
scope_completeness_check Bare "Complete" claims without scoped corpus definition
heuristic_extraction_check Filename/keyword matching claimed as full coverage
closeout_transcript_crosscheck Closeout claims "no changes" but transcript shows write events
evidence_inventory_integrity Inflated inventory counts vs transcript tool outputs
evidence_validation_integrity Test/lint output mismatch with closeout claims
evidence_depth Shallow/minimal evidence stubs
git_status_authenticity Fabricated git status not matching transcript

Dogfood

Run automated dogfood cases to verify the gate catches known failure patterns:

python scripts/run_dogfood.py

See dogfood/dogfood_report.md for results and examples/dogfood/ for test case fixtures.

Policy Packs

Three built-in policies in prove_it_ai_gate/policies/:

Policy Use Case
read_only_audit.yml Audits, reviews, listings, evaluations
code_change.yml Code modifications with tests and validation
corpus_audit.yml Full-corpus scans with extraction artifacts

Evidence Folder Contract

Every agent task should produce:

evidence/
  brief.md, plan.md, commands.jsonl, changed_files.txt
  closeout.md, risks.md
  validation/test_output.txt, lint_output.txt, typecheck_output.txt, audit_guard.txt
  artifacts/inventory.json, extracted_findings.json
  workspace/git_status_before.txt, git_status_after.txt, diff_summary.patch
  transcript.jsonl

See docs/evidence-folder-contract.md for requirements by task type.

Docs

License

MIT — see LICENSE.

Metadata

Release files for prove-it-ai-gate 0.3.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for prove-it-ai-gate 0.3.2
File Size Uploaded
prove_it_ai_gate-0.3.2.tar.gz 49.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for prove-it-ai-gate 0.3.2
File Interpreter ABI Platform
prove_it_ai_gate-0.3.2-py3-none-any.whl Python 3 none any Details

Total release size: 92.5 kB

Release files / prove_it_ai_gate-0.3.2.tar.gz

Download URL prove_it_ai_gate-0.3.2.tar.gz
Size 49.7 kB
Tags Source
SHA-256 checksum
How to use checksums
b33c07a18ef8b7000a703bb61a807d518268b41627ed3c9b58288d17796430a6
BLAKE2b-256 checksum
How to use checksums
c6261241f99a6058f09d936954feec430ecac9d6d418280773a98188e0515ad4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 26, 2026.

Transparency log

Release files / prove_it_ai_gate-0.3.2-py3-none-any.whl

Download URL prove_it_ai_gate-0.3.2-py3-none-any.whl
Size 42.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
df54569e620b614e8380e195497a85f3cc946223e3a13b1fe91acb077cee30d6
BLAKE2b-256 checksum
How to use checksums
fbbe4cda2acc980395fc17f78980e53bc6d42fca3b2dd8198324b3061e5c318e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 26, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

0.3.2 This release

2 release files

0.3.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page