vastai-sdk 0.4.2.dev2

SDK for Vast.ai GPU Cloud Service

Vast.ai Python SDK

The official Vast.ai SDK pip package.

Install

pip install vastai-sdk

Examples

NOTE: Ensure your Vast.ai API key is set in your working environment as VAST_API_KEY. Alternatively, you may pass the API key in as a parameter to either client.

Using the VastAI CLI client

1. Create the client

from vastai import VastAI
vastai = VastAI() # or, VastAI("YOUR_API_KEY")

2. Run commands

vastai.search_offers()

3. Get help

help(v.create_instances)

Using the Serverless client

1. Create the client

from vastai import Serverless
serverless = Serverless() # or, Serverless("YOUR_API_KEY")

2. Get an endpoint

endpoint = await serverless.get_endpoint("my-endpoint")

3. Make a request

request_body = {
    "model": "Qwen/Qwen3-8B",
    "prompt" : "Who are you?",
    "max_tokens" : 100,
    "temperature" : 0.7
}
response = await serverless.request("/v1/completions", request_body)

4. Read the response

text = response["response"]["choices"][0]["text"]
print(text)

Find more examples in the examples directory