Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Agent Framework Lab

This is the experimental package for Microsoft Agent Framework, agent-framework-lab, which contains various lab modules built on top of the core framework. Lab modules are not part of the core framework and may experience breaking changes or be deprecated in the future.

What are Lab Modules?

Lab modules are extensions to the core Agent Framework that fall into one of the following categories:

  1. Incubation of new features that may get incorporated by the core framework.
  2. Research prototypes built on the core framework.
  3. Benchmarks and experimentation tools.

Lab Modules

  • gaia: Evaluate your agents using the GAIA benchmark for general assistant tasks
  • tau2: Evaluate your agents using the TAU2 benchmark for customer support tasks
  • lightning: RL training for agents using Agent Lightning

Repository Structure

agent-framework-lab/
├── pyproject.toml          # Single package configuration for agent-framework-lab
├── uv.lock                 # Standalone Lab dependency resolution
├── README.md               # This file
├── LICENSE                 # License file
├── namespace/              # Centralized namespace package files
│   └── agent_framework/
│       └── lab/
│           ├── gaia/       # Re-exports from agent_framework_lab_gaia
│           ├── lightning/  # Re-exports from agent_framework_lab_lightning
│           └── tau2/       # Re-exports from agent_framework_lab_tau2
├── gaia/                   # GAIA module implementation
│   └── agent_framework_lab_gaia/
├── lightning/              # Lightning module implementation
│   └── agent_framework_lab_lightning/
└── tau2/                   # TAU2 module implementation
    └── agent_framework_lab_tau2/

This structure maintains a single PyPI package agent-framework-lab while supporting modular imports through the namespace package mechanism.

Installation

To install each lab module, use the extras syntax with pip:

pip install "agent-framework-lab[gaia]"
pip install "agent-framework-lab[tau2]"
pip install "agent-framework-lab[lightning]"

Lab currently supports Python 3.10–3.14. PyArrow 26 now provides Python 3.15 wheels for the GAIA extra, but the Tau2 dependency chain still includes DeepDiff with cachebox 5.x, whose PyO3 version rejects Python 3.15 builds.

Usage

Import and use lab modules from the agent_framework.lab namespace. For example, to use the GAIA module:

# Using GAIA module
from agent_framework.lab.gaia import GAIA

Running Tests Locally

Lab is excluded from the root Python uv workspace so its experimental dependencies do not constrain released packages. It resolves released Core and provider distributions by default. Create its environment and run its checks from this directory:

cd python/packages/lab
uv sync --all-extras --all-groups
uv run poe test
uv run poe pyright

Lab release artifacts are built and published separately from the root python-release.yml workflow. From this directory, maintainers can create the standalone wheel and source distribution in the shared Python release directory:

uv build --out-dir ../../dist

Lightning observability tests intentionally exercise heavier tracing paths and are marked as resource_intensive:

uv run pytest lightning/tests/test_lightning.py -m "resource_intensive" -q

Lab-only dependency changes update this directory's uv.lock, not the root Python workspace lock.

Depending on new framework APIs

Lab cannot consume unreleased APIs directly from the root workspace. For a change that spans Lab and another Agent Framework package:

  1. Merge and release the Core or provider change first.
  2. Update the relevant dependency floor in this pyproject.toml after that release is available.
  3. Refresh the Lab lock with uv lock --upgrade-package <distribution-name>.
  4. Implement and validate the Lab change against the published dependency.

For example, release agent-framework-openai before using a new OpenAI adapter API from Lab, then update the Lab dependency and run:

uv lock --upgrade-package agent-framework-openai
uv sync --all-extras --all-groups

Do not add local-path or root-workspace source overrides as a shortcut. Those overrides would make root package metadata changes affect the Lab lock and reintroduce the dependency coupling this standalone project avoids.

Should I consume Lab Modules?

If you are looking for stable and production-ready features, you should not use lab modules. Stick to the core framework.

If you are looking for experimentation, research, or want to benchmark different approaches -- most importantly, if you don't mind breaking changes and potential deprecations -- then lab modules are for you.

Contributing to Lab Modules

Microsoft-maintained modules

For Microsoft-maintained modules in this repository, please follow standard contribution guidelines and submit pull requests directly to this repository.

Community modules

If you want to contribute a community-maintained lab module:

  1. Create a new repository on GitHub for your module
  2. Tag your repository with agent-framework-lab for discoverability
  3. Submit a PR to add a link to your repository in the Lab Modules section above
  4. Use the PR title format: [New Lab Module] Your Module Name

We will review your submission based on the guidelines below.

Guidelines

  1. Purpose: Community modules should fit into one of the three categories of lab modules (incubation, research, benchmarks)
  2. Namespace: Community modules should avoid the agent_framework.lab namespace (reserved for modules maintained in this repository)
  3. Dependencies: Minimize external dependencies, always include agent-framework as a base dependency
  4. Documentation: Include comprehensive README with installation instructions and usage examples
  5. Tests: Write comprehensive tests with good coverage
  6. Type hints: Always include type hints and a py.typed file
  7. Versioning: Use semantic versioning, start with 0.1.0 for initial releases

Metadata

Release files for agent-framework-lab 1.0.0b261022

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for agent-framework-lab 1.0.0b261022
File Size Uploaded Provenance Actions
agent_framework_lab-1.0.0b261022.tar.gz 28.0 kB Without provenance Details for agent_framework_lab-1.0.0b261022.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for agent-framework-lab 1.0.0b261022
File Interpreter ABI Platform Actions
agent_framework_lab-1.0.0b261022-py3-none-any.whl Python 3 none any Details for agent_framework_lab-1.0.0b261022-py3-none-any.whl

Total release size: 58.2 kB

Release files / agent_framework_lab-1.0.0b261022.tar.gz

Download URL agent_framework_lab-1.0.0b261022.tar.gz
Size 28.0 kB
Tags Source
SHA-256 checksum
How to use checksums
a3f902bf9da7effa1e09a7d2216eab09964d048b60e597b77d96ce73719d9352
BLAKE2b-256 checksum
How to use checksums
a810617858571799235517de6ab79521c83d9964239c91ca23b884da2ecfec7e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / agent_framework_lab-1.0.0b261022-py3-none-any.whl

Download URL agent_framework_lab-1.0.0b261022-py3-none-any.whl
Size 30.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
41c4d5be31411dfc6eb1239e757260218d107f1aef2de531c626d1b3a6766931
BLAKE2b-256 checksum
How to use checksums
4161e4436e0223e2706be60657f17ce9e0266fdd0359bd9f983528ea751d8c16
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for agent-framework-lab 1.0.0b261022

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page