Skip to main content

dstack is an open-source orchestration engine for running AI workloads on any cloud or on-premises.

Project description

dstack is a unified control plane for GPU provisioning and orchestration that works with any GPU cloud, Kubernetes, or on-prem clusters.

It streamlines development, training, and inference, and is compatible with any hardware, open-source tools, and frameworks.

Accelerators

dstack supports NVIDIA, AMD, Google TPU, and Tenstorrent accelerators out of the box.

Latest news ✨

How does it work?

Launch the server

Before using dstack through CLI or API, set up a dstack server. If you already have a running dstack server, you only need to install the CLI.

To orchestrate compute across GPU clouds or Kubernetes clusters, you need to configure backends.

When using dstack with on-prem servers, backend configuration isn’t required. Simply create SSH fleets once the server is up.

The server can be installed on Linux, macOS, and Windows (via WSL 2). It requires Git and OpenSSH.

$ uv tool install "dstack[all]" -U
$ dstack server

Applying ~/.dstack/server/config.yml...

The admin token is "bbae0f28-d3dd-4820-bf61-8f4bb40815da"
The server is running at http://127.0.0.1:3000/

For more details on server configuration options, see the Server deployment guide.

Install the CLI

If the CLI is not installed with the server

Once the server is up, you can access it via the dstack CLI.

The CLI can be installed on Linux, macOS, and Windows. It requires Git and OpenSSH.

$ uv tool install dstack -U

To point the CLI to the dstack server, configure it with the server address, user token, and project name:

$ dstack project add \
    --name main \
    --url http://127.0.0.1:3000 \
    --token bbae0f28-d3dd-4820-bf61-8f4bb40815da

Configuration is updated at ~/.dstack/config.yml

Install agent skills

Install dstack skills to help AI agents use the CLI and edit configuration files.

$ npx skills add dstackai/dstack

AI agents like Claude, Codex, and Cursor can now create and manage fleets and submit workloads on your behalf.

Define configurations

dstack supports the following configurations:

  • Fleets — for managing cloud and on-prem clusters
  • Dev environments — for interactive development using a desktop IDE
  • Tasks — for scheduling jobs (incl. distributed jobs) or running web apps
  • Services — for deployment of models and web apps (with auto-scaling and authorization)
  • Volumes — for managing persisted volumes

Configuration can be defined as YAML files within your repo.

Apply configurations

Apply the configuration via the dstack apply CLI command, a programmatic API, or through AI agent skills.

dstack automatically manages provisioning, job queuing, auto-scaling, networking, volumes, run failures, out-of-capacity errors, port-forwarding, and more — across clouds and on-prem clusters.

Useful links

For additional information, see the following links:

Contributing

You're very welcome to contribute to dstack. Learn more about how to contribute to the project at CONTRIBUTING.md.

License

Mozilla Public License 2.0

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dstack-0.20.18rc1.tar.gz (47.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dstack-0.20.18rc1-py3-none-any.whl (16.4 MB view details)

Uploaded Python 3

File details

Details for the file dstack-0.20.18rc1.tar.gz.

File metadata

  • Download URL: dstack-0.20.18rc1.tar.gz
  • Upload date:
  • Size: 47.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dstack-0.20.18rc1.tar.gz
Algorithm Hash digest
SHA256 5cc73b2ad162701cf98ec25c14b20fa48e521152b94202318e9f3b302ca4973c
MD5 022ed32dfd6d3cc1bad97ae3184d10c1
BLAKE2b-256 9af56817eb6a410a3146ac29c87695044a8ec934360fdacf9db0c74ff6696765

See more details on using hashes here.

File details

Details for the file dstack-0.20.18rc1-py3-none-any.whl.

File metadata

  • Download URL: dstack-0.20.18rc1-py3-none-any.whl
  • Upload date:
  • Size: 16.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dstack-0.20.18rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 cb2db12acc09c3dc8c6dc9ce5300964ca5f30bfeeb6fcd73b63efc5cbdcd379c
MD5 60b2d9376c814d76efa9e58039d94115
BLAKE2b-256 cc208c0a0d91353e8271a2acc1f53561445ac64c98d710f56a5ade79b9316d2e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page