Skip to main content

Autonomous QA Agent — scan, test, and fix any codebase automatically

Project description

QA Agent — Complete Client Guide

What This Does

QA Agent autonomously scans your entire codebase, writes test cases for every function, runs them, finds bugs, explains them clearly, and fixes them automatically — then asks for your approval before committing anything.

Supports: Python, Kotlin, Java, Vert.x, JavaScript, TypeScript, Go, Rust, React, Vue, ML/AI models, and more.


Prerequisites (Client Machine)

Requirement Version How to install
Docker Desktop 24+ https://docker.com/products/docker-desktop
Python 3.10+ https://python.org
16GB RAM For running LLM models locally
20GB disk For Docker images + LLM models

Privacy guarantee: Your code NEVER leaves your machine. The LLM runs locally via Ollama.


Install (One Command)

# Mac / Linux / Windows WSL:
curl -fsSL https://install.qa-agent.dev | bash

# Windows (PowerShell):
irm https://install.qa-agent.dev/windows | iex

This automatically:

  1. Checks Docker is running
  2. Starts all 7 AI services in Docker
  3. Downloads LLM models (qwen2.5-coder — private, runs locally)
  4. Installs the qa-agent CLI
  5. Runs a health check

First Scan

# Go to your project directory
cd /path/to/your/codebase

# Run full autonomous scan
qa-agent scan .

What you'll see:

QA Agent — Autonomous scan
Repo: /path/to/your/codebase
Languages: all
Mode: exhaustive

[scanning]   Found 1,247 source files
[indexing]   Indexed 3,891 functions
[generating] Generated 3,891 test files (parallel, 4 workers)
[running]    2,847/3,891 tests passing
[healing]    Self-healed 891 wrong assertion values
[fixing]     Analysing 153 real failures...

┌─────────────────────────────────────────────┐
│  Bug Fix Proposal                           │
│  File: src/payment/calculator.kt            │
│  Confidence: 94%                            │
│                                             │
│  Root cause: Tax rate multiplied instead    │
│  of applied as percentage                   │
│                                             │
│  Diff:                                      │
│  - return amount * taxRate                  │
│  + return amount * (taxRate / 100.0)        │
└─────────────────────────────────────────────┘
Approve this patch? [y/N]: y

[PASS] Patch committed and verified.

╔══════════════════════════════════════════════╗
║         QA Agent — Scan Report               ║
║  Status: PASS                                ║
║  Files scanned:    1,247                     ║
║  Functions tested: 3,891                     ║
║  Tests passed:     3,891 / 3,891  (100%)     ║
║  Bugs found:       153                       ║
║  Bugs fixed:       153 / 153                 ║
║  Time:             14m 32s                   ║
║  YOUR CODEBASE IS GREEN                      ║
╚══════════════════════════════════════════════╝

Common Commands

# Full scan (all files, all languages)
qa-agent scan .

# Only scan files changed since last commit (fast re-scan)
qa-agent scan . --changed-only

# Scan specific languages only
qa-agent scan . --lang python,kotlin,java

# CI/CD mode — auto-approve patches (no prompts)
qa-agent scan . --auto-approve

# Check system health
qa-agent doctor

# Check status of a running scan
qa-agent status <job-id>

# Approve/reject a pending patch
qa-agent approve <job-id> <patch-id>
qa-agent approve <job-id> <patch-id> --reject

CI/CD Integration

GitHub Actions

name: QA Agent Scan
on: [push, pull_request]
jobs:
  qa-scan:
    runs-on: self-hosted   # needs Docker + qa-agent installed
    steps:
      - uses: actions/checkout@v4
      - name: Run QA Agent
        run: qa-agent scan . --auto-approve --output json > qa-report.json
      - name: Upload Report
        uses: actions/upload-artifact@v4
        with:
          name: qa-report
          path: qa-report.json

GitLab CI

qa-scan:
  stage: test
  tags: [docker]
  script:
    - qa-agent scan . --auto-approve
  artifacts:
    paths: [qa-report.json]

Configuration

Create .qa-agent.env in your repo root:

# LLM Provider: ollama (local) | openai | anthropic
LLM_PROVIDER=ollama

# For cloud LLMs (faster, requires API key)
# LLM_PROVIDER=openai
# OPENAI_API_KEY=sk-...

# Models
TEST_GEN_MODEL=qwen2.5-coder:1.5b   # fast, for test generation
PATCH_MODEL=qwen2.5-coder:7b         # accurate, for bug fixing

# Scan behaviour
MAX_CHUNKS=1000                       # max functions to generate tests for
MAX_FIX_ATTEMPTS=3                    # LLM retry limit per bug

Supported Languages

Language Test Framework Status
Python pytest
Kotlin JUnit 5 + Maven
Java JUnit 5 + Maven
Vert.x (Java/Kotlin) JUnit 5
JavaScript Jest
TypeScript Jest
Go go test
Rust cargo test
React/Vue/Svelte Jest + Testing Library
ML (PyTorch/TF) pytest

How It Works (Under the Hood)

Your codebase
      │
      ▼
  qa-agent scan .
      │
   [Brain — LangGraph AI]
      │
      ├── Scan: finds all source files (git-aware, skips unchanged)
      ├── Index: tree-sitter AST → function-level chunks → Qdrant
      ├── Generate: LLM writes positive + negative + edge-case tests
      ├── Run: executes tests in isolated Docker sandbox
      ├── Heal: fixes wrong assertion values automatically
      ├── Fix: LLM analyses real bugs → proposes patches → YOU approve
      └── Report: full summary with pass rate, bugs found/fixed

Key guarantees:

  • Code stays on your machine (Ollama runs locally)
  • Nothing is committed without your approval
  • Re-scans only process changed files (git diff)
  • Known bug patterns are cached (instant fix second time)

Uninstall

# Stop and remove all containers + data
docker compose -f ~/.qa-agent/docker-compose.yml down -v

# Remove CLI
pip uninstall qa-agent

# Remove models (optional, frees ~8GB)
docker exec qa-ollama ollama rm qwen2.5-coder:7b
docker exec qa-ollama ollama rm qwen2.5-coder:1.5b

Troubleshooting

# Check all services are running
qa-agent doctor

# View logs
docker compose logs qa-brain --tail=50
docker compose logs qa-celery --tail=50

# Restart services
docker compose restart

# Common issues:
# "Ollama not responding" → docker restart qa-ollama
# "Tests not generating" → check OLLAMA_HOST in qa-app logs
# "Scan hangs" → qa-agent status <job-id> to check phase

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autonomous_qa_agent-1.0.5.tar.gz (11.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autonomous_qa_agent-1.0.5-py3-none-any.whl (11.3 kB view details)

Uploaded Python 3

File details

Details for the file autonomous_qa_agent-1.0.5.tar.gz.

File metadata

  • Download URL: autonomous_qa_agent-1.0.5.tar.gz
  • Upload date:
  • Size: 11.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for autonomous_qa_agent-1.0.5.tar.gz
Algorithm Hash digest
SHA256 035bdf53a8bd03d0fc00b4819777b0ce8fd797b484052a52deb7c1705644cd0a
MD5 6110e9543d34106f474f1325fa839ac2
BLAKE2b-256 d7aa89076a42081b14cb1fc1bfaaa9d33678919d799d913605f24dfd1cd363f5

See more details on using hashes here.

File details

Details for the file autonomous_qa_agent-1.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for autonomous_qa_agent-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 0088177772ae59da20373dd57ea89538728374a49b7a39d57da198343612b8b5
MD5 af0321f372128d433048efb5fa80deaa
BLAKE2b-256 285da0fd489c3290713840b2f5aa859cce3d25bc33231b44e06c4031fb1a4907

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page