spindynamics 0.3.1

Python SDK for the SpinDynamics inference routing platform

SpinDynamics Python SDK

Official Python SDK for the SpinDynamics inference routing platform.

Installation

pip install spindynamics

Quick Start

from spindynamics import Cortex

client = Cortex(api_key="sd_live_...")

deployment = client.deploy(
    model="llama-3.1-70b",
    strategy="adaptive",
    regions=["us-east-1", "eu-west-1"],
)

response = client.infer(
    deployment_id=deployment.id,
    prompt="Explain quantum computing",
    max_tokens=512,
)

print(response.text)

Documentation

Full documentation at spindynamics.net/docs.