Skip to main content

Production-ready runtime for building and orchestrating intelligent multi-agent AI systems

Project description

MUXI Runtime

License Python 3.10+

The execution engine for AI agent formations.

For most users: Install MUXI CLI for the complete experience. This repo is for contributors and developers embedding the runtime directly.

[!IMPORTANT]

MUXI Ecosystem

This repository is part of the larger MUXI ecosystem.

๐Ÿ“‹ Complete architectural overview: See muxi/ARCHITECTURE.md - explains how core repositories fit together, dependencies, status, and roadmap.

What is MUXI Runtime?

MUXI Runtime transforms declarative YAML configurations into running AI systems. It's the core engine that powers the MUXI Server.

Core responsibilities:

  • Formation execution - Loads and runs agent configurations from YAML
  • Overlord orchestration - Routes requests, manages clarifications, coordinates workflows
  • Memory systems - Three-tier memory (buffer, persistent, vector)
  • Tool integration - MCP protocol support for external tools
  • Multi-tenant isolation - User and session management

Architecture

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  MUXI Server (Go) - Formation lifecycle management  โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                         โ”‚
                         โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  MUXI Runtime (Python) โ—„โ”€โ”€ THIS REPO                โ”‚
โ”‚  โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”  โ”‚
โ”‚  โ”‚  Formation Engine (YAML loader & validator)   โ”‚  โ”‚
โ”‚  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค  โ”‚
โ”‚  โ”‚  Overlord โ”‚ Agents โ”‚ Workflow โ”‚ Background    โ”‚  โ”‚
โ”‚  โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค  โ”‚
โ”‚  โ”‚  Memory โ”‚ MCP โ”‚ A2A โ”‚ LLM โ”‚ Observability     โ”‚  โ”‚
โ”‚  โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜  โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                         โ”‚
                         โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  External Services (LLM APIs, MCP Servers, DBs)     โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Package Structure

The runtime uses src/muxi/runtime/ to share the muxi namespace with the Python SDK:

src/muxi/runtime/
โ”œโ”€โ”€ formation/          # Formation engine
โ”‚   โ”œโ”€โ”€ overlord/       # Central orchestration
โ”‚   โ”œโ”€โ”€ agents/         # Agent implementations
โ”‚   โ”œโ”€โ”€ workflow/       # Task decomposition, SOPs
โ”‚   โ”œโ”€โ”€ server/         # Formation API (FastAPI)
โ”‚   โ””โ”€โ”€ background/     # Webhooks, scheduling, async
โ”œโ”€โ”€ services/           # Runtime services
โ”‚   โ”œโ”€โ”€ memory/         # Memory systems
โ”‚   โ”œโ”€โ”€ mcp/            # MCP client
โ”‚   โ”œโ”€โ”€ a2a/            # Agent-to-agent
โ”‚   โ””โ”€โ”€ llm/            # LLM abstraction
โ””โ”€โ”€ datatypes/          # Type definitions

Quick Start

Using with MUXI Server (recommended)

# Install MUXI CLI
curl -fsSL https://muxi.ai/install | sh

# Create and run a formation
muxi new my-assistant
cd my-assistant
muxi dev

Embedding directly

pip install muxi-runtime
from muxi.runtime import Formation
import asyncio

async def main():
    formation = Formation()
    await formation.load("formation.afs")
    overlord = await formation.start_overlord()

    response = await overlord.chat(
        "Hello!",
        user_id="user123"
    )
    print(response)

asyncio.run(main())

Development

git clone https://github.com/muxi-ai/runtime
cd runtime
pip install -e ".[dev]"

# Run tests
pytest tests/unit -v
pytest tests/integration -v
pytest e2e/tests -v

See contributing/README.md for contributor documentation.

Related Repositories

Repo Description
muxi-ai/muxi Main repo with architecture docs
muxi-ai/server Go server that hosts this runtime
muxi-ai/cli Command-line tool
muxi-ai/sdks Python, TypeScript, Go SDKs
muxi-ai/schemas API schemas

Documentation

License

Elastic License 2.0 - Free to use, modify, and embed in products. Cannot be offered as a hosted service.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

muxi_runtime-0.20260302.0.tar.gz (1.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

muxi_runtime-0.20260302.0-py3-none-any.whl (1.5 MB view details)

Uploaded Python 3

File details

Details for the file muxi_runtime-0.20260302.0.tar.gz.

File metadata

  • Download URL: muxi_runtime-0.20260302.0.tar.gz
  • Upload date:
  • Size: 1.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for muxi_runtime-0.20260302.0.tar.gz
Algorithm Hash digest
SHA256 5c1444d2805029d3c54db4e7d6598e78b78bed8fcc85f2e94b1450a4a5da85d6
MD5 7953b5841eed14401e8a36fbf14775e0
BLAKE2b-256 ba2f34fa49dfca5a6e348b30abe24da5350343bb5f7b4bc7853b7938c85b1b64

See more details on using hashes here.

Provenance

The following attestation bundles were made for muxi_runtime-0.20260302.0.tar.gz:

Publisher: release.yml on muxi-ai/runtime

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file muxi_runtime-0.20260302.0-py3-none-any.whl.

File metadata

File hashes

Hashes for muxi_runtime-0.20260302.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6224ef666985875eeda6c68ff81dc3449998323c6c7f092830f73785aaedded4
MD5 8751dbb5c70b9c009af54160a9026cee
BLAKE2b-256 1ab8edbd044474dd431dfc0129c5e3eaf27a04b2391a846ee2ca16cec423d49a

See more details on using hashes here.

Provenance

The following attestation bundles were made for muxi_runtime-0.20260302.0-py3-none-any.whl:

Publisher: release.yml on muxi-ai/runtime

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page