Skip to main content

MARL — Model-Agnostic Runtime Middleware for LLMs

Project description

MARL — Model-Agnostic Runtime Middleware for LLMs

5-stage multi-agent reasoning pipeline that reduces LLM hallucination by 70%+.

Quick Start

from marl import Marl

# OpenAI
ml = Marl.from_openai("sk-...")
result = ml.run("Your complex question")
print(result.answer)

# Any OpenAI-compatible API
ml = Marl.from_openai_compatible("https://api.x.ai/v1", "key", "grok-3")

9 Emergence Modes

from marl import Marl, MarlConfig

ml = Marl.from_openai("sk-...", config=MarlConfig(
    mode="emergence",
    emergence_type="create"  # invent|create|recipe|pharma|genomics|chemistry|ecology|law|document
))

As Proxy Server (1-line integration)

ml = Marl.from_openai("sk-...")
ml.serve(port=8080)
# Now use base_url="http://localhost:8080/v1" in any app

Pipeline

S1 Hypothesis → S2 Solver → S3 Auditor → S4 Verifier → S5 Synthesizer

Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

marl_middleware-1.0.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (349.7 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

File details

Details for the file marl_middleware-1.0.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for marl_middleware-1.0.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 f1a14ab7420e651c0f6b5038e543ad71c3c86213d168e466fdf7cb5cdd5ada6d
MD5 66893c46c8420a9f8f16799601a5472b
BLAKE2b-256 29f5e7816f09e05860ba298bec2393319d67a39cfc8559505941cac0c8ad594a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page