llmgovernor 0.2.0

LLM Cost Governance — budget enforcement, cost tracking, and smart model routing for AI agent fleets.

LLMGovernor

LLM Cost Governance — budget enforcement, cost tracking, and smart model routing for AI agent fleets

LLMGovernor provides intelligent cost monitoring and budget enforcement for AI agent applications. Track spending, set limits, and route to the right model across OpenAI, Anthropic, and AWS Bedrock.

Installation

Install the core package:

pip install llmgovernor

Or install with all provider dependencies:

pip install llmgovernor[all]

Provider-specific installations:

pip install llmgovernor[openai]     # OpenAI support
pip install llmgovernor[anthropic]  # Anthropic support
pip install llmgovernor[bedrock]    # AWS Bedrock support

Quick Start

from llmgovernor import Fleet

# Initialize your fleet
fleet = Fleet(api_key="your-llmgovernor-api-key")

# Decorate your agent functions
@fleet.agent(name="research-assistant", budget_limit=50.00)
async def research_assistant(query: str):
    # Your agent logic here
    response = await openai_client.chat.completions.create(...)
    return response

# Monitor via dashboard
print(f"Dashboard: {fleet.dashboard_url}")

Features

• Real-time cost tracking — Monitor LLM spend across providers
• Budget enforcement — Set limits per agent or fleet-wide
• Usage analytics — Detailed breakdowns by model, provider, and agent
• Multi-provider support — OpenAI, Anthropic, AWS Bedrock
• Smart model routing — Route to the right model for the job
• Dashboard monitoring — Web interface for fleet oversight

Documentation

Full documentation: llmgovernor.ai

License

MIT License — see LICENSE file for details.