costimizer 0.1.6

Costimizer AI observability SDK for LLM FinOps

Costimizer Python SDK

Capture LLM calls and send them to Costimizer FinOps.

Install only the provider client you use

pip install "costimizer[openai]"
pip install "costimizer[openrouter]"
pip install "costimizer[otel-langchain]"   # LangChain auto-instrument
pip install "costimizer[otel-openai]"      # native OpenAI auto-instrument

Core SDK (httpx only) installs with:

pip install costimizer

OpenAI

pip install "costimizer[openai]"

from costimizer import Costimizer
from costimizer.ai.openai import OpenAI

costimizer = Costimizer(
    project_token="fo_ingest_your_key",
    host="https://api.costimizer.ai",
)

client = OpenAI(
    api_key="sk-...",
    costimizer_client=costimizer,
)

response = client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello"}],
    costimizer_trace_name="support-chat",
)
costimizer.shutdown()

OpenRouter

OpenRouter uses the OpenAI-compatible API, so it installs the openai package:

pip install "costimizer[openrouter]"

from costimizer import Costimizer
from costimizer.ai.openrouter import OpenRouter

costimizer = Costimizer(project_token="fo_ingest_your_key")

client = OpenRouter(
    api_key="sk-or-...",
    costimizer_client=costimizer,
)

response = client.chat.completions.create(
    model="anthropic/claude-3.5-sonnet",
    messages=[{"role": "user", "content": "Hello"}],
    costimizer_trace_name="router-chat",
)
costimizer.shutdown()

LangChain (callback)

pip install "costimizer[langchain]"

Manual callback alternative when OTel is not available:

from costimizer import Costimizer
from costimizer.langchain import CostimizerCallbackHandler
from langchain_openai import ChatOpenAI

costimizer = Costimizer(project_token="fo_ingest_your_key")
handler = CostimizerCallbackHandler(
    costimizer,
    trace_name="support-chat",
    distinct_id="user-123",
)

model = ChatOpenAI(model="gpt-4o-mini", temperature=0.7, seed=42)
model.invoke("Hello", config={"callbacks": [handler]})
costimizer.shutdown()

OpenTelemetry (native OpenAI)

pip install "costimizer[otel-openai]"

from costimizer import Costimizer
from costimizer.otel import instrument
import openai

costimizer = Costimizer(project_token="fo_ingest_your_key")
instrument(costimizer, openai=True, trace_name="support-chat")

client = openai.OpenAI()
client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello"}],
)
costimizer.shutdown()

Optional tracking fields

All provider wrappers accept the same Costimizer-only kwargs:

Kwarg	Purpose
costimizer_trace_name	Label for dashboards
costimizer_trace_id	Group related calls
costimizer_distinct_id	User or session ID
costimizer_properties	Custom metadata dict
costimizer_privacy_mode	"metadata_only" (default) or "full_content"