Skip to main content

Rust kernel with Python bindings for the Amplifier modular AI agent framework

Project description

Amplifier Core

The ultra-thin kernel of the Amplifier modular AI agent system -- now implemented in Rust with Python bindings via PyO3.

Purpose

Amplifier Core provides the mechanisms for building modular AI agent systems. Following the Linux kernel model, it's a tiny, stable center that rarely changes, with all policies and features implemented as replaceable modules at the edges.

The kernel is implemented in Rust for performance and type safety. Python bindings via PyO3 provide the same API that existing consumers already use -- existing Python code requires zero changes. Same imports, same API, same behavior.

Core responsibilities:

  • Module discovery and loading
  • Lifecycle coordination
  • Hook system and events
  • Session management
  • Stable contracts and APIs

Architecture

+---------------------------------------------------------------+
| RUST KERNEL (crates/amplifier-core/)                          |
| * Session lifecycle       * Event system                      |
| * Coordinator             * Hook registry                     |
| * Type-safe contracts     * Cancellation tokens               |
+----------------------------+----------------------------------+
                             | PyO3 bridge (bindings/python/)
                             v
+---------------------------------------------------------------+
| PYTHON BINDINGS (python/amplifier_core/)                      |
| * Same public API          * Pydantic models                  |
| * Module loader (Python)   * Backward-compatible imports      |
+----------------------------+----------------------------------+
                             | protocols (Tool, Provider, etc.)
                             v
+---------------------------------------------------------------+
| MODULES (Userspace - Swappable)                               |
| * Providers: LLM backends (Anthropic, OpenAI, Azure, Ollama) |
| * Tools: Capabilities (filesystem, bash, web, search)        |
| * Orchestrators: Execution loops (basic, streaming, events)  |
| * Contexts: Memory management (simple, persistent)           |
| * Hooks: Observability (logging, redaction, approval)        |
+---------------------------------------------------------------+

Rust Kernel

The kernel is implemented in Rust for performance and type safety. Key details:

  • Rust crate: crates/amplifier-core/ -- pure Rust kernel with all core types, traits, and engine logic
  • PyO3 bridge: bindings/python/ -- thin Python bindings that expose Rust types to Python
  • Python source: python/amplifier_core/ -- Pydantic models, module loader, and backward-compatible API surface

The RUST_AVAILABLE flag (on amplifier_core._engine) indicates whether the Rust engine loaded successfully. When available:

  • Top-level imports (from amplifier_core import AmplifierSession) return Rust-backed types
  • Submodule imports (from amplifier_core.session import AmplifierSession) return Python types for backward compatibility
  • HookRegistry uses the Rust implementation for all hook dispatch
  • CancellationToken uses the Rust implementation

For consumers, this is transparent -- the API is identical regardless of which implementation is active.

Design Philosophy

Mechanisms, Not Policies

The kernel provides capabilities without decisions:

Kernel Provides (Mechanism) Modules Decide (Policy)
Module loading Which modules to load
Event emission What to log, where
Session lifecycle Orchestration strategy
Hook registration Security policies

Litmus test: "Could two teams want different behavior?" -> If yes, it's policy -> Module, not kernel.

Stability Guarantees

  • Backward compatible: Existing modules continue working across kernel updates
  • Minimal runtime dependencies: Only pydantic, pyyaml, typing-extensions (unchanged for consumers)
  • Single maintainer scope: Can be understood by one person
  • Additive evolution: Changes extend, don't break

Installation

For consumers

pip install amplifier-core

This installs a pre-built wheel with the Rust kernel included. No Rust toolchain required.

For complete Amplifier installation and usage: -> https://github.com/microsoft/amplifier

For developers

Building from source requires the Rust toolchain:

# Install Rust (if not already installed)
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

# Build and install in development mode
pip install maturin
maturin develop

# Or with uv
uv run maturin develop

See docs/RUST_CORE_TESTING.md for the full development setup guide.

Build dependencies: Rust 1.70+, maturin

Core Concepts

Session

Execution context with mounted modules and conversation state. Lifespan: initialize() -> execute() -> cleanup().

Mount Plan

Configuration dictionary specifying which modules to load and their configuration. Apps/bundles compile to Mount Plans.

Coordinator

Infrastructure context providing session_id, config access, hooks, and mount points. Injected into all modules.

Module Types

All modules use Python Protocol (structural typing, no inheritance required):

  • Provider - LLM backends (name, complete(), parse_tool_calls(), get_info(), list_models())
  • Tool - Agent capabilities (name, description, execute())
  • Orchestrator - Execution loops (execute())
  • ContextManager - Memory (add_message(), get_messages(), compact())
  • Hook - Observability (call(event, data) -> HookResult)

API Example

from amplifier_core import AmplifierSession

# Define mount plan (modules must be installed or discoverable)
config = {
    "session": {
        "orchestrator": "loop-basic",
        "context": "context-simple"
    },
    "providers": [
        {"module": "provider-anthropic"}
    ],
    "tools": [
        {"module": "tool-filesystem"},
        {"module": "tool-bash"}
    ]
}

# Create and use session
async with AmplifierSession(config) as session:
    response = await session.execute("List files in current directory")

Module Development

Modules implement protocols via structural typing (duck typing):

from amplifier_core.interfaces import Tool
from amplifier_core.models import ToolResult

class MyTool:
    """Implements Tool protocol without inheritance."""

    @property
    def name(self) -> str:
        return "my_tool"

    @property
    def description(self) -> str:
        return "Does something useful"

    async def execute(self, input: dict) -> ToolResult:
        """Execute tool with input dict."""
        return ToolResult(
            output=f"Processed: {input.get('param')}",
            error=None
        )

# Mount function (entry point)
async def mount(coordinator, config):
    tool = MyTool()
    await coordinator.mount("tools", tool, name="my_tool")

    async def cleanup():
        pass  # Cleanup resources

    return cleanup

Entry point (pyproject.toml):

[project.entry-points."amplifier.modules"]
my-tool = "amplifier_module_my_tool:mount"

For complete module development guide: -> https://github.com/microsoft/amplifier

Documentation

Rust/Python Type Mapping:

  • CONTRACTS.md - Authoritative Rust/Python type mapping for the PyO3 boundary

Module Contracts (Entry Point for Developers):

Specifications (Detailed Design):

Detailed Guides:

Philosophy:

Testing

# Rust kernel tests
cargo test -p amplifier-core

# Python tests (includes binding tests)
uv run pytest tests/ bindings/python/tests/ -q --tb=short

# Full coverage
uv run pytest tests/ bindings/python/tests/ --cov

# Validate Rust kernel integration
uv run python tests/validate_rust_kernel.py

Contributing

[!NOTE] This project is not currently accepting external contributions, but we're actively working toward opening this up. We value community input and look forward to collaborating in the future. For now, feel free to fork and experiment!

Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit Contributor License Agreements.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

amplifier_core-1.5.2-cp311-abi3-win_arm64.whl (7.6 MB view details)

Uploaded CPython 3.11+Windows ARM64

amplifier_core-1.5.2-cp311-abi3-win_amd64.whl (8.9 MB view details)

Uploaded CPython 3.11+Windows x86-64

amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.5 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ x86-64

amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (7.5 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ ARM64

amplifier_core-1.5.2-cp311-abi3-macosx_11_0_arm64.whl (7.2 MB view details)

Uploaded CPython 3.11+macOS 11.0+ ARM64

amplifier_core-1.5.2-cp311-abi3-macosx_10_12_x86_64.whl (8.1 MB view details)

Uploaded CPython 3.11+macOS 10.12+ x86-64

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-win_arm64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-win_arm64.whl
Algorithm Hash digest
SHA256 fce557b1f1ee5934fab3d01ff970494737de0129bff175d88152cd5cadb214ff
MD5 b2b1efa237160d1a183a6a4c831c11d1
BLAKE2b-256 d2bfbbf51f655c513179f58fd290cb06928dcd20816ed76f7e1c7d0a62abfaed

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-win_arm64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 f9ec917c3c2b504a4149b940768a8f848b11aae8360d77bffce3fbe7a11f5f70
MD5 2a5034fabe6958f65eb08a98da7d7e3a
BLAKE2b-256 7e0ff83c04f317afe71647ac50089508bc6ba8419c351a68176e0a96db236b5c

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-win_amd64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 14f9e2704a76d810705549ddb3c8da1bfeabdf4a83c3bdd5a85efed6c03c899f
MD5 3d4aa4f0b12da093be26e60f5becc422
BLAKE2b-256 c429df54f552be2ef3144b2e6d6c6746fe2e77b3f74556af03a4fd67bc3bdd4f

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 100f4a34a04cedce7e5655ba09d53a2f00cc898943fd5c2b51911a7100a5ae2c
MD5 36c3d24c792bbf1a745b7ceab7b74dab
BLAKE2b-256 b946b9cc09dc360315d4535adc1ee2406ee24a71d1a2fc9e776a34b643fa22c4

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f962a5c7398d7437a8fc0409133647370a300ebaa568cd70a772cbba61af47c7
MD5 1a6ecbfe3978927c070c9120b1cb4f69
BLAKE2b-256 285b0e87180bf2a47d83945666e1d4f4d1819aa1c10c561ad9bfc768eaed09be

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-macosx_11_0_arm64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amplifier_core-1.5.2-cp311-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for amplifier_core-1.5.2-cp311-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 450de24a759e4dd685c04554d7aeebad54b4f6df6c94956e36c2c6bc91eac428
MD5 f36f99d95f9734b62b74f294ead4a298
BLAKE2b-256 07a7757224dc2dc2159abf26e310d5d55e54ce78893b6bda6bf48dbfc4de248e

See more details on using hashes here.

Provenance

The following attestation bundles were made for amplifier_core-1.5.2-cp311-abi3-macosx_10_12_x86_64.whl:

Publisher: rust-core-wheels.yml on microsoft/amplifier-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page