alcf-ai 0.2.0

ALCF Inference Gateway SDK

ALCF AI Inference Services SDK

This package provides Python client and CLI tools to facilitate usage of the ALCF AI Inference services.

Usage:

# Log in with Globus:
uvx alcf-ai auth login

# Then use the SDK programmatically:
uv run --with alcf-ai python

# Or from the command line:
uvx alcf-ai ls-jobs sophia

SDK Usage

from alcf_ai import InferenceClient
from rich import print

# Automatically uses cached refresh tokens from previous login:
client = InferenceClient()

# Programmatically discover endpoints:
print(client.list_endpoints()["clusters"]["sophia"])

# Get an OpenAI API client for an ALCF cluster:
oai = client.clusters("sophia").openai
print(
    oai.chat.completions.create(
        model="openai/gpt-oss-120b",
        messages=[{"role": "user", "content": "Hello there!"}],
    )
)