Skip to main content

AI-native development quality gate — full-chain coverage from requirements to code

Project description

Qualix

Tests PyPI Python License codecov

AI-native development quality gates for requirements, designs, tests, and code reviews.

Qualix turns product requirements into traceable engineering checks. Instead of stopping at line coverage, it follows requirement IDs through design coverage, test intent, generated unit tests, audit reports, and review findings.

In plain language: Qualix helps an AI coding agent keep track of what the product asked for, what the design promised, what the tests actually prove, and what still looks risky. It is a workflow and evidence system around your agent, not another test runner.

The Short Version

Give Qualix a PRD, then move through small quality checkpoints:

  1. Turn messy requirements into explicit requirement items and business rules.
  2. Check whether a technical design really covers those requirements.
  3. Design tests around business behavior, not just lines of code.
  4. Audit generated tests and code review findings against the original intent.

The terms map to normal development work:

Term Plain meaning
Phase One workflow step, such as structuring requirements or auditing tests
Gate A pass/fail check before moving on
Judge / Critique A second-pass review of the agent's own output
SE A key semantic expectation the product depends on
EUT A test target: behavior that should be proven by unit tests
RSM A requirement-to-code/test trace map used to catch missing coverage

You can learn the vocabulary gradually. For a first run, start with Q01 and inspect the generated requirement report.

Why Qualix

Problem What Usually Happens Qualix Approach
Requirement drift PRDs lose detail as they move into design and code Q01 extracts structured REQ/BR/SE items with traceable IDs
Design gaps Technical designs are reviewed loosely Q03/Q04 review design quality and requirement coverage
Shallow tests Coverage is green but business behavior is not tested Q05a/Q05b design and generate requirement-driven unit tests
Weak assertions Tests assert calls or existence, not semantics Q06 audits test intent, weak assertions, and coverage evidence
Review inconsistency Code review depends on reviewer memory Q07 produces structured, evidence-backed review findings

Status

Qualix is early and evolving. The repository is useful for experimentation, internal quality-gate workflows, and evaluating the phase model. APIs, file formats, and phase reports may still change before a stable 1.0.0 release.

Quick Start

git clone https://github.com/alexangelzhang/qualix.git
cd qualix
./install.sh --dev
qualix-run --profile python-service hello init
qualix-run ingest examples/hello-prd.md --project hello
qualix-run hello startup --json

This creates a local .qualix/ workspace and ingests a synthetic PRD. It does not require an enterprise document login.

Then, when you are ready to run an AI-backed phase, set a model key and execute Q01:

export ANTHROPIC_API_KEY="..."   # or OPENAI_API_KEY / GEMINI_API_KEY / DASHSCOPE_API_KEY
qualix-run --profile python-service hello execute Q01 --json
qualix-run hello finalize Q01 --json
qualix-run hello approve Q01 --json

To try Qualix without private project data, start with the synthetic example in examples/hello-prd.md, or read the fuller expense approval demo in examples/expense-approval.

Inside an AI coding agent, use the project starter instructions:

$qualix-starter

You can also run phases manually:

qualix-run my-project execute Q01 --json
qualix-run my-project finalize Q01 --json
qualix-run my-project approve Q01 --json

Phase Model

Q01 Requirements Structuring
├── Q02 Technical Design Generation (optional)
│   └── Q03 Technical Design Quality Review
│       └── Q04 Technical Design Coverage Audit
│           └── Q07 Code Review
└── Q05a EUT Matrix Design
    └── Q05b Unit Test Code Generation
        └── Q06 Unit Test Coverage Audit
Phase Goal Main Output
Q01 Structure requirements REQ/BR/SE/GAP/OPEN report and JSON
Q02 Generate technical design Implementation-ready design draft
Q03 Review design quality Architecture/API/data/error/performance findings
Q04 Audit design coverage Requirement-to-design coverage matrix
Q05a Design executable unit-test targets EUT matrix
Q05b Generate unit-test code Test code and execution notes
Q06 Audit unit-test quality Coverage and assertion-quality report
Q07 Review code changes Evidence-backed code review report

Every phase follows the same lifecycle:

collect evidence -> execute skill -> write report + structured JSON -> self-check -> judge/critique -> finalize -> approve

New to the terms? Read Concepts for the short version of Phase, Gate, Harness, Judge, Critique, SE, EUT, and RSM.

Installation Notes

The root install.sh installs the Python package and copies runtime resources into a user-level Qualix directory. Development mode keeps those resources symlinked to this repository:

./install.sh --dev

For a lighter editable install:

python -m pip install -e '.[dev]'

Optional extras:

python -m pip install -e '.[tree-sitter]'
python -m pip install -e '.[feishu]'
python -m pip install -e '.[vlm]'
python -m pip install -e '.[deepeval]'

Tree-sitter adds file-local symbol extraction and parse diagnostics for Java, TypeScript, Go, and Python. Q01 document ingest works with local Markdown/text/html files today:

qualix-run ingest docs/prd.md --project my-project

Enterprise document URLs are handled through the provider-based ingest layer. DingTalk and Feishu/Lark URLs are recognized as optional integrations; if a connector is not configured, Qualix explains the missing setup instead of starting OAuth automatically. For a first run, export the document from your browser or use a local Markdown/text/html file.

For model-provider configuration, see Model Setup.

For ecosystem maturity, see Language Support. Java is the deepest path today; TypeScript, Go, and Python have built-in providers for detection and basic quality gates, plus optional Tree-sitter code intelligence.

CLI Overview

Global commands:

qualix init
qualix dashboard start
qualix version

Project commands:

qualix-run <project_id> init
qualix-run <project_id> startup --json
qualix-run <project_id> status --json
qualix-run <project_id> execute <phase_id> --json
qualix-run <project_id> finalize <phase_id> --json
qualix-run <project_id> approve <phase_id> --json
qualix-run <project_id> doctor

Repository Layout

qualix/
├── src/qualix/          # Python package and CLI/runtime implementation
├── skills/              # Phase skills and workflow prompts
├── references/          # Report templates and risk catalogs
├── profiles/            # Language/domain profiles
├── regression/          # Regression cases and failure-library examples
├── examples/            # Synthetic input examples
├── docs/                # User and architecture docs
├── tests/               # pytest suite
├── AGENTS.md            # Codex/opencode instructions
├── CLAUDE.md            # Claude Code instructions
├── GEMINI.md            # Gemini CLI instructions
└── install.sh           # Local installer

Development

ruff check src/ tests/
pytest tests/ -q

For a narrower smoke test after install changes:

python -m pytest tests/test_version.py tests/test_install_sh.py -q

Data And Examples

The public repository should contain only synthetic or sanitized regression examples. Real enterprise failure libraries, customer requirements, and private review data should stay outside the public repo or be distributed under a separate commercial data license.

Public benchmark seeds live in benchmarks/semantic-coverage. They are small, synthetic cases for inspecting semantic coverage failures by hand.

Comparison

Qualix is adjacent to AI PR reviewers, test-generation tools, and coding-agent workflows, but its core differentiator is requirement-semantic traceability rather than line coverage or generic diff review. See Comparison for details.

Community And Security

License

Apache License 2.0. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

qualix-0.2.0a1.tar.gz (1.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

qualix-0.2.0a1-py3-none-any.whl (1.1 MB view details)

Uploaded Python 3

File details

Details for the file qualix-0.2.0a1.tar.gz.

File metadata

  • Download URL: qualix-0.2.0a1.tar.gz
  • Upload date:
  • Size: 1.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for qualix-0.2.0a1.tar.gz
Algorithm Hash digest
SHA256 f64335d77927a7673131f6219e47bf3d86450fe4d3b1eed17e0d44f8737460f9
MD5 54980cf888c498c6ec0c17053e64dd77
BLAKE2b-256 0c28012132ab69c4ce16911c0319848162211820c1d6812f4ad1b6422e2ec36f

See more details on using hashes here.

Provenance

The following attestation bundles were made for qualix-0.2.0a1.tar.gz:

Publisher: publish.yml on alexangelzhang/qualix

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file qualix-0.2.0a1-py3-none-any.whl.

File metadata

  • Download URL: qualix-0.2.0a1-py3-none-any.whl
  • Upload date:
  • Size: 1.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for qualix-0.2.0a1-py3-none-any.whl
Algorithm Hash digest
SHA256 f10a168fe0849b1b5f371ea86c6f6c4cc4f485b01f751ce67e678ee77a19df84
MD5 5ff10cba522681517c20734bef1523b0
BLAKE2b-256 e2d4c78d3d1b783bddd02688957ade925d0ace448c63feffdbe3f0e3ea7ea24b

See more details on using hashes here.

Provenance

The following attestation bundles were made for qualix-0.2.0a1-py3-none-any.whl:

Publisher: publish.yml on alexangelzhang/qualix

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page