spt-models

Python client for the SPT Models GPU inference platform.

Model aliases

An admin can publish client-facing names (gpt-4, prod-embeddings, …) that point at a catalogue model. Every /v1/* call accepts an alias wherever it accepts a slug, and echoes the alias back in the response model field. client.admin.aliases manages them (admin token required); Model.alias_of tells an alias entry apart from a real model in client.models.list().

from spt_models import Client

with Client(api_key="sk-...", admin_token="...") as client:
    # Create an alias pointing at model id 1, then use it like a slug.
    alias = client.admin.aliases.create("gpt-4", 1, description="OpenAI drop-in")
    resp = client.chat.completions.create(
        model="gpt-4", messages=[{"role": "user", "content": "Hello"}]
    )
    assert resp.model == "gpt-4"          # the alias is echoed, not the slug

    # Repoint, disable, or drop it — clients keep the same name throughout.
    client.admin.aliases.update(alias.id, model_id=2)
    client.admin.aliases.update(alias.id, enabled=False)
    client.admin.aliases.delete(alias.id)

    for m in client.models.list().data:
        if m.alias_of:
            print(f"{m.id} -> {m.alias_of}")

Async variants follow the usual a prefix: alist, acreate, aupdate, adelete.