styrr

Multi-model LLM router with automatic fallback — Python SDK.

Never crash because a single model is rate-limited or down. Styrr chains models in order and falls through automatically.

Install

pip install styrr

Optional extras:

pip install styrr[bedrock]      # AWS Bedrock support (boto3)
pip install styrr[huggingface]  # HuggingFace Inference Endpoints
pip install styrr[all]          # Everything

Quick Start

import os
import asyncio
from styrr import StyrRouter

async def main():
    router = StyrRouter(
        models=[
            {"id": "openai/gpt-4o-mini"},
            {"id": "nvidia/nemotron:free"},
        ],
        api_key=os.environ["OPENROUTER_API_KEY"],
    )

    result = await router.prompt("What is FinOps in 2 sentences?")
    print(result)

asyncio.run(main())

Fallback Chain

Models are tried in order. If the first returns 429, 5xx, or times out, the next is tried automatically.

router = StyrRouter(
    models=[
        {"id": "anthropic.claude-sonnet-4"},          # Bedrock primary
        {"id": "openai/gpt-4o-mini"},                  # OpenRouter fallback
        {"id": "nvidia/nemotron-3-super-120b:free"},   # Free fallback
    ],
    api_key=os.environ["OPENROUTER_API_KEY"],
    on_fallback=lambda f, e, n: print(f"Fell back: {f} -> {n}: {e}"),
)

Tool Calling

result = await router.call(
    [
        {"role": "system", "content": "You have access to tools."},
        {"role": "user", "content": "What's the weather in Paris?"},
    ],
    tools=[{
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get current weather for a city",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {"type": "string", "description": "City name"}
                },
                "required": ["location"],
            },
        },
    }],
)

if result.tool_calls:
    for tc in result.tool_calls:
        print(f"{tc['name']}({tc['arguments']})")
else:
    print(result.text)

Providers

Provider detection is automatic based on model ID.

Streaming

async for event in router.stream([{"role": "user", "content": "Hi"}]):
    if event["type"] == "text_delta":
        print(event["delta"], end="", flush=True)
    elif event["type"] == "done":
        print(f'\nDone — model: {event["model_used"]}')
    elif event["type"] == "error":
        print(f'Error: {event["error"]}')

API

StyrRouter

StyrResponse

Architecture

Your App
  └─ StyrRouter
       ├─ OpenAICompatProvider  (OpenRouter, OpenAI, NVIDIA, etc.)
       ├─ BedrockProvider       (AWS Bedrock)
       └─ HuggingFaceProvider   (HF Inference Endpoints)

Running Tests

pip install pytest pytest-asyncio httpx
pytest tests/

License

Apache-2.0