lmux-openai 0.2.0

OpenAI provider for lmux

lmux-openai

OpenAI provider for lmux. Wraps the openai SDK.

Supports chat completions, streaming, embeddings, and the Responses API.

Part of the lmux ecosystem: standardized interface, cost tracking on every response, and registry-based routing across providers.

Auth

Set OPENAI_API_KEY in your environment. The default OpenAIEnvAuthProvider reads it automatically.

from lmux_openai import OpenAIProvider

provider = OpenAIProvider()

Or pass a custom auth provider:

provider = OpenAIProvider(auth=my_auth_provider)

Usage

Chat

from lmux import UserMessage

response = provider.chat("gpt-4o", [UserMessage(content="Hello")])
print(response.content)
print(response.cost)

Streaming

for chunk in provider.chat_stream("gpt-4o", [UserMessage(content="Hello")]):
    if chunk.delta:
        print(chunk.delta, end="")

Embeddings

response = provider.embed("text-embedding-3-small", "Hello")
print(response.embeddings)

Responses API

response = provider.create_response("gpt-4o", "Hello")
print(response.output_text)

Async

All methods have async variants: achat, achat_stream, aembed, acreate_response.

Registry

Use with the lmux registry to route across multiple providers:

from lmux import Registry

registry = Registry()
registry.register("openai", provider)
response = registry.chat("openai/gpt-4o", messages)

Provider Params

Pass OpenAI-specific parameters via provider_params:

from lmux_openai import OpenAIParams

response = provider.chat(
    "o3",
    messages,
    provider_params=OpenAIParams(reasoning_effort="high", service_tier="flex"),
)

Parameter	Type	Description
service_tier	"auto" | "default" | "flex"	Service tier selection
reasoning_effort	"low" | "medium" | "high"	Reasoning effort for o-series models
seed	int	Deterministic sampling seed
user	str	End-user identifier

Constructor Options

OpenAIProvider(
    auth=...,           # AuthProvider[str], default: OpenAIEnvAuthProvider()
    base_url=...,       # Optional base URL override
    timeout=...,        # Request timeout in seconds
    max_retries=...,    # Max retry attempts
)