modelgates

Official ModelGates SDK for Python. Drop-in replacement for the OpenAI SDK that routes requests through ModelGates.

Install

pip install modelgates

Usage

from modelgates import ModelGates

client = ModelGates(
    api_key="sk-mg-...",
    # optional attribution headers
    referer="https://your-site.com",
    title="Your App Name",
)

# Chat completions
completion = client.chat.completions.create(
    model="openai/gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)

# Streaming
stream = client.chat.completions.create(
    model="openai/gpt-4o",
    messages=[{"role": "user", "content": "Hello!"}],
    stream=True,
)
for chunk in stream:
    print(chunk.choices[0].delta.content or "", end="")

# Embeddings
embedding = client.embeddings.create(
    model="openai/text-embedding-3-small",
    input="Hello world",
)

# List models (ModelGates-specific)
models = client.list_models()
print([m["name"] for m in models["data"]])

# Rankings
rankings = client.list_rankings("trending")

Publish

cd packages/py-sdk
python -m build
python -m twine upload dist/*

Requires a PyPI account with access to the modelgates project.