Vast.ai Python SDK & CLI
The official Vast.ai Python package — provides both the CLI and SDK for managing Vast.ai GPU cloud resources, plus a serverless client for endpoint inference.
Install
pip install vastai
Note:
pip install vastai-sdkalso works and installs the same package. Both package names are supported for backward compatibility.
Quickstart
-
Get your API key from https://cloud.vast.ai/manage-keys/
-
Set your API key:
vastai set api-key YOUR_API_KEY
- Test a search:
vastai search offers --limit 3
You should see a short list of available GPU offers.
CLI Usage
The vastai command provides full access to the Vast.ai platform from your terminal:
vastai search offers 'gpu_name=RTX_4090 num_gpus>=4'
vastai create instance 12345 --image pytorch/pytorch --disk 32 --ssh --direct
vastai show instances
vastai stop instance 12345
vastai destroy instance 12345
Run vastai --help for a full list of commands. You can also use --help on any subcommand:
vastai search offers --help
vastai create instance --help
SDK Usage
from vastai import VastAI
vast = VastAI() # uses VAST_API_KEY env var, or pass api_key="..."
vast.search_offers(query='gpu_name=RTX_4090 num_gpus>=4')
vast.show_instances()
vast.start_instance(id=12345)
vast.stop_instance(id=12345)
Use help(vast.search_offers) to view documentation for any method.
Migrating from
vastai-sdk? The old import still works:from vastai_sdk import VastAI
Using the Serverless Client
- Create the client
from vastai import Serverless
serverless = Serverless() # or, Serverless("YOUR_API_KEY")
- Get an endpoint
endpoint = await serverless.get_endpoint("my-endpoint")
- Make a request
request_body = {
"model": "Qwen/Qwen3-8B",
"prompt" : "Who are you?",
"max_tokens" : 100,
"temperature" : 0.7
}
response = await serverless.request("/v1/completions", request_body)
- Read the response
text = response["response"]["choices"][0]["text"]
print(text)
Find more examples in the examples/ directory.
Tab Completion
Tab completion is supported in Bash and Zsh via argcomplete (installed automatically). To enable it:
activate-global-python-argcomplete
Or for a single session:
eval "$(register-python-argcomplete vastai)"
AI Agents
Vast.ai has a skill for AI coding agents (Claude Code, Cursor, Windsurf, Codex, etc.):
npx skills add vast-ai/vast-cli
This installs the Vast.ai skill so your agent can search offers, create instances, and manage GPU workflows directly. See CLI SKILL.md or SDK SKILL.md for the full reference.
Contributing
This repository is open source. If you find a bug, please open an issue. PRs are welcome.
3 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vastai-1.2.2.tar.gz.
File metadata
- Download URL: vastai-1.2.2.tar.gz
- Upload date:
- Size: 254.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.4.1 CPython/3.12.13 Linux/6.17.0-1018-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
335c53b3fb3b52f0afdd4cd916a5ee8dbba720b5219a6a94e07f1cee756808b9
|
|
| MD5 |
fc19c358305950b57d607aa3f9d1f152
|
|
| BLAKE2b-256 |
edc7bf4ff51637ec1c15e3987f444c69716892f164c81d52393d6af8a47a55d5
|
File details
Details for the file vastai-1.2.2-py3-none-any.whl.
File metadata
- Download URL: vastai-1.2.2-py3-none-any.whl
- Upload date:
- Size: 292.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.4.1 CPython/3.12.13 Linux/6.17.0-1018-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a45a9d80c509c63e9b41a4d7f565982577b611c59fc1bffd000e95ddc50c904e
|
|
| MD5 |
0cb1b7b42559bd7711418283ce2e5a55
|
|
| BLAKE2b-256 |
9d6df1537708efcb1e76da333ed3d4f790a1a9c13b02e6c36d1f96005a940eea
|
