Skip to main content

Multi-Agent Testing Framework

Agnostic testing framework designed for multi-agent development systems with GitHub integration.

Philosophy

Doesn't duplicate existing solutions - extends them for multi-agent workflows:

  • Uses your existing pytest, Playwright, Jest configurations
  • Adds multi-agent coordination testing on top
  • Integrates with GitHub workflows and PR processes
  • Tests agent task assignment and completion

Installation

pip install multiagent-testing

Quick Start

# Detect existing testing infrastructure
mtest detect

# Run all tests with multi-agent awareness
mtest run

# Run specific test types
mtest run --backend          # API/backend only
mtest run --frontend         # UI/E2E only
mtest run --agents          # Agent coordination
mtest run --github          # Workflow automation

# Test specific agents
mtest agent --agent gemini --task "code review"
mtest agent --agent codex --task "implementation"

# Initialize testing for new projects
mtest init --template agent
mtest init --template pytest
mtest init --template playwright

Features

🔍 Framework Detection

  • Automatically detects pytest, Playwright, Jest, etc.
  • Suggests integration strategies
  • Works with existing test suites

🤖 Agent Testing

  • Test agent coordination and communication
  • Validate task assignment and completion
  • Test agent-specific capabilities
  • Parallel agent testing

⚙️ GitHub Integration

  • Test workflow automation
  • Validate PR processes
  • Test issue creation and routing
  • Integration with GitHub Actions

🌐 Agnostic Design

  • Works with any existing testing framework
  • Doesn't replace your current setup
  • Adds multi-agent layer on top
  • Extensible for custom workflows

Architecture

mtest run --all
├── Backend Tests (pytest/existing)
├── Frontend Tests (Playwright/existing) 
├── Agent Coordination Tests (new)
└── GitHub Workflow Tests (new)

Integration with Multi-Agent Ecosystem

# Full stack setup
pip install multiagent-core multiagent-agentswarm multiagent-devops multiagent-testing

# Initialize project
multiagent init --with agentswarm,devops,testing

# Run complete test suite
mtest run --parallel

Examples

Testing Agent Task Completion

# Test if agents complete assigned tasks
mtest agent --task "convert JS to Python"

Testing Multi-Agent Coordination

# Test agent coordination during complex tasks
mtest run --agents --parallel

CI/CD Integration

# In GitHub Actions
- name: Run Multi-Agent Tests
  run: mtest run --github

Contributing

This framework is designed to be:

  • Agnostic: Works with any existing testing setup
  • Extensible: Easy to add new agent types and test patterns
  • Non-invasive: Doesn't replace existing tools
  • GitHub-native: Built for modern multi-agent development workflows

Metadata

Release files for multiagent-testing 1.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for multiagent-testing 1.0.1
File Size Uploaded Provenance
multiagent_testing-1.0.1.tar.gz 4.9 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for multiagent-testing 1.0.1
File Interpreter ABI Platform
multiagent_testing-1.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 10.5 kB

Release files / multiagent_testing-1.0.1.tar.gz

Download URL multiagent_testing-1.0.1.tar.gz
Size 4.9 kB
Tags Source
SHA-256 checksum
How to use checksums
8b66904b7ebc901317a50cb7ac23b4b786f10864877230155cd0045766e53447
BLAKE2b-256 checksum
How to use checksums
c56a71755926a4318528f5ff01b9e3a70313d6a3bf39e24051fca487babf002b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.23

Release files / multiagent_testing-1.0.1-py3-none-any.whl

Download URL multiagent_testing-1.0.1-py3-none-any.whl
Size 5.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
947eeab760f09d46af6ad61d5faacf7fc81b0800e0dfafb72da12c1c69c45b63
BLAKE2b-256 checksum
How to use checksums
c829d1ac231be0ca311d81c64fc7a46a0de194864b31759e618d8ace2e88beb2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.9.23

Security for multiagent-testing 1.0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release

1.0.1 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page