Skip to main content

Autonomous QA Agent — scan, test, and fix any codebase automatically

Project description

QA Agent — Complete Client Guide

What This Does

QA Agent autonomously scans your entire codebase, writes test cases for every function, runs them, finds bugs, explains them clearly, and fixes them automatically — then asks for your approval before committing anything.

Supports: Python, Kotlin, Java, Vert.x, JavaScript, TypeScript, Go, Rust, React, Vue, ML/AI models, and more.


Prerequisites (Client Machine)

Requirement Version How to install
Docker Desktop 24+ https://docker.com/products/docker-desktop
Python 3.10+ https://python.org
16GB RAM For running LLM models locally
20GB disk For Docker images + LLM models

Privacy guarantee: Your code NEVER leaves your machine. The LLM runs locally via Ollama.


Install (One Command)

# Mac / Linux / Windows WSL:
curl -fsSL https://install.qa-agent.dev | bash

# Windows (PowerShell):
irm https://install.qa-agent.dev/windows | iex

This automatically:

  1. Checks Docker is running
  2. Starts all 7 AI services in Docker
  3. Downloads LLM models (qwen2.5-coder — private, runs locally)
  4. Installs the qa-agent CLI
  5. Runs a health check

First Scan

# Go to your project directory
cd /path/to/your/codebase

# Run full autonomous scan
qa-agent scan .

What you'll see:

QA Agent — Autonomous scan
Repo: /path/to/your/codebase
Languages: all
Mode: exhaustive

[scanning]   Found 1,247 source files
[indexing]   Indexed 3,891 functions
[generating] Generated 3,891 test files (parallel, 4 workers)
[running]    2,847/3,891 tests passing
[healing]    Self-healed 891 wrong assertion values
[fixing]     Analysing 153 real failures...

┌─────────────────────────────────────────────┐
│  Bug Fix Proposal                           │
│  File: src/payment/calculator.kt            │
│  Confidence: 94%                            │
│                                             │
│  Root cause: Tax rate multiplied instead    │
│  of applied as percentage                   │
│                                             │
│  Diff:                                      │
│  - return amount * taxRate                  │
│  + return amount * (taxRate / 100.0)        │
└─────────────────────────────────────────────┘
Approve this patch? [y/N]: y

[PASS] Patch committed and verified.

╔══════════════════════════════════════════════╗
║         QA Agent — Scan Report               ║
║  Status: PASS                                ║
║  Files scanned:    1,247                     ║
║  Functions tested: 3,891                     ║
║  Tests passed:     3,891 / 3,891  (100%)     ║
║  Bugs found:       153                       ║
║  Bugs fixed:       153 / 153                 ║
║  Time:             14m 32s                   ║
║  YOUR CODEBASE IS GREEN                      ║
╚══════════════════════════════════════════════╝

Common Commands

# Full scan (all files, all languages)
qa-agent scan .

# Only scan files changed since last commit (fast re-scan)
qa-agent scan . --changed-only

# Scan specific languages only
qa-agent scan . --lang python,kotlin,java

# CI/CD mode — auto-approve patches (no prompts)
qa-agent scan . --auto-approve

# Check system health
qa-agent doctor

# Check status of a running scan
qa-agent status <job-id>

# Approve/reject a pending patch
qa-agent approve <job-id> <patch-id>
qa-agent approve <job-id> <patch-id> --reject

CI/CD Integration

GitHub Actions

name: QA Agent Scan
on: [push, pull_request]
jobs:
  qa-scan:
    runs-on: self-hosted   # needs Docker + qa-agent installed
    steps:
      - uses: actions/checkout@v4
      - name: Run QA Agent
        run: qa-agent scan . --auto-approve --output json > qa-report.json
      - name: Upload Report
        uses: actions/upload-artifact@v4
        with:
          name: qa-report
          path: qa-report.json

GitLab CI

qa-scan:
  stage: test
  tags: [docker]
  script:
    - qa-agent scan . --auto-approve
  artifacts:
    paths: [qa-report.json]

Configuration

Create .qa-agent.env in your repo root:

# LLM Provider: ollama (local) | openai | anthropic
LLM_PROVIDER=ollama

# For cloud LLMs (faster, requires API key)
# LLM_PROVIDER=openai
# OPENAI_API_KEY=sk-...

# Models
TEST_GEN_MODEL=qwen2.5-coder:1.5b   # fast, for test generation
PATCH_MODEL=qwen2.5-coder:7b         # accurate, for bug fixing

# Scan behaviour
MAX_CHUNKS=1000                       # max functions to generate tests for
MAX_FIX_ATTEMPTS=3                    # LLM retry limit per bug

Supported Languages

Language Test Framework Status
Python pytest
Kotlin JUnit 5 + Maven
Java JUnit 5 + Maven
Vert.x (Java/Kotlin) JUnit 5
JavaScript Jest
TypeScript Jest
Go go test
Rust cargo test
React/Vue/Svelte Jest + Testing Library
ML (PyTorch/TF) pytest

How It Works (Under the Hood)

Your codebase
      │
      ▼
  qa-agent scan .
      │
   [Brain — LangGraph AI]
      │
      ├── Scan: finds all source files (git-aware, skips unchanged)
      ├── Index: tree-sitter AST → function-level chunks → Qdrant
      ├── Generate: LLM writes positive + negative + edge-case tests
      ├── Run: executes tests in isolated Docker sandbox
      ├── Heal: fixes wrong assertion values automatically
      ├── Fix: LLM analyses real bugs → proposes patches → YOU approve
      └── Report: full summary with pass rate, bugs found/fixed

Key guarantees:

  • Code stays on your machine (Ollama runs locally)
  • Nothing is committed without your approval
  • Re-scans only process changed files (git diff)
  • Known bug patterns are cached (instant fix second time)

Uninstall

# Stop and remove all containers + data
docker compose -f ~/.qa-agent/docker-compose.yml down -v

# Remove CLI
pip uninstall qa-agent

# Remove models (optional, frees ~8GB)
docker exec qa-ollama ollama rm qwen2.5-coder:7b
docker exec qa-ollama ollama rm qwen2.5-coder:1.5b

Troubleshooting

# Check all services are running
qa-agent doctor

# View logs
docker compose logs qa-brain --tail=50
docker compose logs qa-celery --tail=50

# Restart services
docker compose restart

# Common issues:
# "Ollama not responding" → docker restart qa-ollama
# "Tests not generating" → check OLLAMA_HOST in qa-app logs
# "Scan hangs" → qa-agent status <job-id> to check phase

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autonomous_qa_agent-1.0.9.tar.gz (12.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autonomous_qa_agent-1.0.9-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file autonomous_qa_agent-1.0.9.tar.gz.

File metadata

  • Download URL: autonomous_qa_agent-1.0.9.tar.gz
  • Upload date:
  • Size: 12.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for autonomous_qa_agent-1.0.9.tar.gz
Algorithm Hash digest
SHA256 e1a9240dcf45325b58800f171d0e2be5fd483827e6f00ba4c84d10018cf2b245
MD5 1fd10b1facb08bed59c3808c10b971ed
BLAKE2b-256 c7024395bc9d27d71754f6c2549f87e59a52e9b5c9655b6f369924614c7d79dd

See more details on using hashes here.

File details

Details for the file autonomous_qa_agent-1.0.9-py3-none-any.whl.

File metadata

File hashes

Hashes for autonomous_qa_agent-1.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 33439d1821386744da00245420c5cc0f86b8c6c0b7abb4aeec0eb696a577784f
MD5 b30d31def23fceb8afdc629144e282d0
BLAKE2b-256 8501f92df512842ce1e74b6daff17fef9e1371eb947b6b16694ce3163c05fdbf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page