dstackai/dstack

dstack is an open-source alternative to Kubernetes and Slurm, designed to simplify GPU allocation and AI workload orchestration for ML teams across top clouds and on-prem clusters.

dstack supports NVIDIA, AMD, Google TPU, Intel Gaudi, and Tens accelerators out of the box.

• [2025/05] dstack 0.19.8: Nebius clusters, GH200 on Lambda
• [2025/04] dstack 0.19.6: Tens, Plugins
• [2025/04] dstack 0.19.5: GCP A3 High clusters
• [2025/04] dstack 0.19.3: GCP A3 Mega clusters
• [2025/03] dstack 0.19.0: Prometheus

Before using dstack through CLI or API, set up a dstack server. If you already have a running dstack server, you only need to set up the CLI.

To use dstack with cloud providers, configure backends via the ~/.dstack/server/config.yml file.

For more details on how to configure backends, check Backends.

For using dstack with on-prem servers, create SSH fleets once the server is up.

You can install the server on Linux, macOS, and Windows (via WSL 2). It requires Git and OpenSSH.

$ uv tool install "dstack[all]" -U

$ pip install "dstack[all]" -U

Once it's installed, go ahead and start the server.

$ dstack server
Applying ~/.dstack/server/config.yml...

The admin token is "bbae0f28-d3dd-4820-bf61-8f4bb40815da"
The server is running at http://127.0.0.1:3000/

For more details on server configuration options, see the Server deployment guide.

$ uv tool install dstack -U

$ pip install dstack -U

$ dstack project add \
    --name main \
    --url http://127.0.0.1:3000 \
    --token bbae0f28-d3dd-4820-bf61-8f4bb40815da
    
Configuration is updated at ~/.dstack/config.yml

dstack supports the following configurations:

• Dev environments — for interactive development using a desktop IDE
• Tasks — for scheduling jobs (incl. distributed jobs) or running web apps
• Services — for deployment of models and web apps (with auto-scaling and authorization)
• Fleets — for managing cloud and on-prem clusters
• Volumes — for managing persisted volumes
• Gateways — for configuring the ingress traffic and public endpoints

Configuration can be defined as YAML files within your repo.

Apply the configuration either via the dstack apply CLI command or through a programmatic API.

dstack automatically manages provisioning, job queuing, auto-scaling, networking, volumes, run failures, out-of-capacity errors, port-forwarding, and more — across clouds and on-prem clusters.

For additional information, see the following links:

• Docs
• Examples
• Discord

You're very welcome to contribute to dstack. Learn more about how to contribute to the project at CONTRIBUTING.md.

Mozilla Public License 2.0