GPUStack Runner
GPUStack Runner registers accelerated backends and inference services for GPUStack. This repository maintains the Python library, container recipes, and measured runner catalog.
Features
- Register accelerated inference services for GPUStack: vLLM, SGLang, MindIE, and VoxBox.
- Select runners with the Python API by backend, service, and dependency constraints, backed by the measured package catalog.
- Build runner images from the maintained container recipes in
pack/.
Supported runners
Each cell shows the newest supported engine version with its runtime line, and every supported version is listed in Supported runners.
| Backend | vLLM | SGLang | MindIE | VoxBox |
|---|---|---|---|---|
| Ascend CANN | 0.30.0(rc) (9.1) |
0.5.20 (9.0) |
2.3.0 (8.5) |
|
| Iluvatar CoreX | 0.8.3 (4.2) |
|||
| NVIDIA CUDA | 0.31.0 (13.0) |
0.5.21 (13.0) |
0.0.21 (12.8) |
|
| Hygon DTK | 0.18.1 (26.04) |
0.5.10 (26.04) |
||
| T-Head HGGC | 0.23.0 (13.0) |
0.5.12 (13.0) |
||
| MetaX MACA | 0.21.0 (3.7) |
0.5.11 (3.7) |
||
| MThreads MUSA | 0.9.2 (4.1.0) |
0.5.7 (4.3.2) |
||
| AMD ROCm | 0.31.0 (7.2) |
0.5.21 (7.2) |
CANN/vLLM images use stable vLLM releases. An (rc) label identifies a prerelease vLLM-Ascend plugin.
Usage
Install the library:
pip install gpustack-runner
Select runners with the Python API:
from gpustack_runner import list_runners
runners = list_runners(
backend="cuda",
service="vllm",
dependencies=(("lmcache", ">=0.4.6"),),
with_unknown_dependencies=False,
)
See the API reference for selection options. The dependency guide explains unknown collection, absent packages, and raw installed versions.
Documentation
- Packaging: service Dockerfiles, matrix selection, image builds, and final-image collection.
- Dependency metadata: installed package records and queries.
- Release automation: weekly proposals, model configuration, PR commands, and post-merge Pack.
- Project instructions: source navigation, development checks, and contribution conventions.
Contributing
Contributions are welcome. Commits must carry a Signed-off-by line certifying the
Developer Certificate of Origin.
Using GPUStack Runner in production? Add your company or project to ADOPTERS.md via pull request.
License
Copyright (c) 2026 The GPUStack authors. Licensed under Apache License 2.0.
1 maintainer
Metadata
1 maintainer
Release files for gpustack-runner 0.1.31.post3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| gpustack_runner-0.1.31.post3.tar.gz | 13.8 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| gpustack_runner-0.1.31.post3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 13.8 MB
Release files / gpustack_runner-0.1.31.post3.tar.gz
| Download URL | gpustack_runner-0.1.31.post3.tar.gz |
|---|---|
| Size | 13.8 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1d00df32ee5dfc94226da87de36c3214ac64d50fdf54a4e1b2c905bb609b1197
|
|
BLAKE2b-256 checksum How to use checksums |
64615d801feaff097f2ffbbfd119bda132330067c1c91c86dbba257f4785fd4f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
Release files / gpustack_runner-0.1.31.post3-py3-none-any.whl
| Download URL | gpustack_runner-0.1.31.post3-py3-none-any.whl |
|---|---|
| Size | 32.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7db7849ec9179b49b0e5f056a14e8e444a69ff22f4dc44c802727ba807a1e1d6
|
|
BLAKE2b-256 checksum How to use checksums |
f01ed67c9f79af18e0a7d9ccc8a14bdbac1218f5f103451a8132c5982dcf3d4e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.24
|
