Skip to main content

Agentic QA Maestro

CI PyPI Python License PRs Welcome

AI-powered QA automation that turns User stories into executed tests — no scripting required.

Give it a ticket, and it will:

  1. Read the acceptance criteria
  2. Generate test cases
  3. Run them in a real browser (Playwright)
  4. Report pass/fail results back to your ticketing system

How It Works

graph LR
    Story["🎫 User Story"] --> Analysis["📝 Requirement Analysis"]
    Analysis --> Discovery["🔍 App Discovery"]
    Discovery --> Tests["✅ Test Case Generation"]
    Tests --> Execution["🌐 Test Execution"]
    Execution --> Report["📋 Bug Reporting"]

QA Maestro runs a 6-phase pipeline:

Phase What Happens
1. Requirement Analysis Fetches the ticket and extracts acceptance criteria
2. App Discovery Launches a browser, explores the live app UI, maps selectors and navigation
2.5 Knowledge Enrichment Loads pre-recorded app flows & known selectors from app_flows/*.yaml
3. Test Case Generation Combines requirements + live discovery + app knowledge to generate test cases
4. Test Execution Runs each test case against the live app, takes screenshots as evidence
5. Bug Reporting Files bug tickets for failures, posts a summary to the original story
6. Cleanup Closes the browser, outputs final pass/fail status

Agents

Agent Role
Orchestrator Coordinates the pipeline end-to-end
JIRA Agent Reads stories, extracts criteria, posts results, files bugs
Browser Agent Explores the app (live discovery) and executes tests via Playwright
App Knowledge Agent Loads pre-recorded app flows, selectors, and feature maps
Test Runner Runs pytest suites and collects results
API Agent Validates REST endpoints against contracts
Research Agent Looks up documentation when needed

Get Started

pip install agentic-qa-maestro    # or: uv tool install agentic-qa-maestro
qa-maestro init                   # scaffold application.yaml, .env, and app_flows/
playwright install chromium       # required once for full browser E2E
qa-maestro --ticket PROJ-123      # run against a ticket

See the Getting Started guide for full installation, configuration, and usage instructions.


Documentation

Guide Description
Getting Started Full setup, configuration & first run
Architecture System design & component details
Contributing How to contribute

Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

License

Apache-2.0 — see LICENSE for details.

Metadata

Release files for agentic-qa-maestro 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for agentic-qa-maestro 0.1.0
File Size Uploaded
agentic_qa_maestro-0.1.0.tar.gz 315.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for agentic-qa-maestro 0.1.0
File Interpreter ABI Platform
agentic_qa_maestro-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 367.7 kB

Release files / agentic_qa_maestro-0.1.0.tar.gz

Download URL agentic_qa_maestro-0.1.0.tar.gz
Size 315.3 kB
Tags Source
SHA-256 checksum
How to use checksums
8165457d486c9fb155ace8df05261b8ad0d1497d3f3744ce21a6a2cd993406f0
BLAKE2b-256 checksum
How to use checksums
992e0f38cdfc772605001c421e5af42e11c7b5bb60ef4101d80aa58f59b827f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.13

Release files / agentic_qa_maestro-0.1.0-py3-none-any.whl

Download URL agentic_qa_maestro-0.1.0-py3-none-any.whl
Size 52.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
dd8343108aa824d7dc55df928a11a664cf1767fd3a48605db1544ddb7129348b
BLAKE2b-256 checksum
How to use checksums
e1e48513eeff990af344ca95198cfa31ca7f01a5ff443056cc84e910b9800772
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.13

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page