coreason-arbitrage

The "Traffic Controller" / The Smart Switch for CoReason-AI.

Installation

pip install coreason-arbitrage

Features

• Intelligent Routing: Cascading model strategy to select the right model for the right task (Tier 1, Tier 2, Tier 3).
• Server Mode: Run as a containerized microservice to act as a centralized traffic controller.
• Cost Optimization: Prevents "Token Burn" by routing simpler tasks to cheaper models and using Economy Mode.
• Resiliency: Circuit Breaker mechanism to failover to backup providers during outages.
• Provider Agnosticism: Decoupled from specific vendors, avoiding lock-in.
• FinOps: Real-time cost tracking and logging.

See Product Requirements for more details.

Usage

For detailed instructions on using coreason-arbitrage as a library or a microservice, please refer to the Usage Guide.

Quick Start (Library)

from coreason_arbitrage.engine import ArbitrageEngine

# Initialize the engine (Singleton)
engine = ArbitrageEngine()

# Get a smart client capable of handling the request
client = engine.get_client()

# Use the client to create a completion
response = client.chat.completions.create(
    messages=[{"role": "user", "content": "Explain quantum computing in simple terms."}],
)

print(response.choices[0].message.content)

Quick Start (Server)

docker run -p 8000:8000 coreason/arbitrage:v0.3.0