Skip to main content

sparkrun — Part of the Spark Arena ecosystem

PyPI version License Documentation Spark Arena

One command to rule them all

Launch, manage, and stop LLM inference workloads on one or more NVIDIA DGX Spark systems — no Slurm, no Kubernetes, no fuss.

Documentation · Quick Start · Recipes · Spark Arena


Install

uvx sparkrun setup

One command — installs sparkrun, then launches the guided setup wizard to create a cluster, configure SSH mesh, detect ConnectX-7 NICs, set up sudoers, and enable earlyoom.

Quick Start

# Run an inference workload
sparkrun run qwen3-1.7b-vllm

# Multi-node tensor parallelism (TP maps to node count on DGX Spark)
sparkrun run qwen3-1.7b-vllm --tp 2

# Re-attach to logs, stop a workload, check status
sparkrun logs qwen3-1.7b-vllm
sparkrun stop qwen3-1.7b-vllm
sparkrun status

Ctrl+C detaches from logs — it never kills your inference job. Your model keeps serving.

See the full CLI reference for all commands and options.

Updating

sparkrun update

Upgrades sparkrun (when installed via uv tool) and refreshes recipe registries.

Update channels (advanced)

Opt into preview builds installed from git instead of PyPI:

sparkrun update --stable   # PyPI stable release (default)
sparkrun update --beta     # develop branch preview
sparkrun update --alpha    # develop-next branch (bleeding edge)
sparkrun update --yolo     # alias for --alpha

sparkrun update with no flag stays on your current channel; a channel flag switches and is remembered for future updates. The same flags work with sparkrun setup install and sparkrun setup update. Stable prints a plain version (0.2.40); beta/alpha add a channel suffix and commit (0.3.0-alpha+g1a2b3c4). Switching from a preview channel back to --stable may downgrade.

Highlights

  • Multi-runtime — vLLM, SGLang, llama.cpp out of the box
  • Multi-node tensor parallelism — --tp 2 = 2 hosts, automatic InfiniBand/RDMA detection
  • VRAM estimation — know if your model fits before you launch (sparkrun show <recipe>)
  • Git-based recipe registries — we publish official recipes, community recipes, and benchmarked recipes via Spark Arena, plus you can add your own registries.
  • Guided setup wizard — cluster creation, SSH mesh, CX7 auto-detection, sudoers, earlyoom
  • Model & container distribution — syncs models and images to cluster nodes over SSH automatically

Spark Arena

Spark Arena is the community hub for DGX Spark recipe benchmarks — browse benchmark results, then run them directly with sparkrun.

Official Recipes

Official Recipes are maintained by the Spark Arena team and hosted on GitHub. They are tested and optimized for NVIDIA DGX Spark systems.

Community Recipes

Community Recipes are contributed by the community and hosted on GitHub.

Sponsored by

scitrera.ai

License

Apache License 2.0 — see LICENSE for details.

Anonymous Telemetry

sparkrun sends basic anonymous usage telemetry to https://telemetry.sparkrun.dev by default. Events include a random installation id stored in ~/.config/sparkrun/config.yaml, sparkrun version, OS/version, system architecture, and command-specific metadata such as run runtime/model/parallelism/source/hardware counts, benchmark category/framework/profile/result keys, update version and registry counts, and setup-wizard step choices.

The data allows us to make informed decisions about new features for sparkrun or the greater DGX Spark ecosystem.

Telemetry very specifically does not include personally identifiable information or information that may reveal trade secrets. Telemetry does not include hostnames, usernames, local file paths, tokens, secrets, logs, private HF or local models, or full command arguments. Disable it persistently with sparkrun setup telemetry --disable, re-enable with sparkrun setup telemetry --enable, or opt out for one process with SPARKRUN_NO_TELEMETRY=1.

Metadata

Release files for sparkrun 0.3.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sparkrun 0.3.7
File Size Uploaded
sparkrun-0.3.7.tar.gz 2.0 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for sparkrun 0.3.7
File Interpreter ABI Platform
sparkrun-0.3.7-py3-none-any.whl Python 3 none any Details

Total release size: 3.3 MB

Release files / sparkrun-0.3.7.tar.gz

Download URL sparkrun-0.3.7.tar.gz
Size 2.0 MB
Tags Source
SHA-256 checksum
How to use checksums
38eca5358fd7a899b6d2fecc282b83d626a89b4f5fbacbdd88ff2afb129faf4a
BLAKE2b-256 checksum
How to use checksums
d6bf343eb80640d351ecbdf5f5c26b5e500f05d6d2ba2e5f75974c94610cd732
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 5, 2026.

Transparency log

Release files / sparkrun-0.3.7-py3-none-any.whl

Download URL sparkrun-0.3.7-py3-none-any.whl
Size 1.3 MB
Tags Python 3
SHA-256 checksum
How to use checksums
85266a628456efd551aba57769e8d77a8cee796133f6948deaaf39775e288516
BLAKE2b-256 checksum
How to use checksums
ac2e72261804f7e986d4079a392d0e7eea40303f3de26533ecaaa62ec270e5e2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 5, 2026.

Transparency log

Release history Release notifications | RSS feed

0.3.10

2 release files

0.3.9

2 release files

0.3.8

2 release files

This release

0.3.7 This release

2 release files

0.3.6

2 release files

0.3.5

2 release files

0.3.4

2 release files

0.3.3

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.39

2 release files

0.2.38

2 release files

0.2.37

2 release files

0.2.36

2 release files

0.2.35

2 release files

0.2.34

2 release files

0.2.33

2 release files

0.2.32

2 release files

0.2.29

2 release files

0.2.28

2 release files

0.2.27

2 release files

0.2.26

2 release files

0.2.25

2 release files

0.2.24

2 release files

0.2.23

2 release files

0.2.22

2 release files

0.2.13

2 release files

0.2.12

2 release files

0.2.11

2 release files

0.2.10

2 release files

0.2.9

2 release files

0.2.8

2 release files

0.2.7

2 release files

0.2.6

2 release files

0.2.5

2 release files

0.2.4

2 release files

0.2.3

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

0.1.14

2 release files

0.1.13

2 release files

0.1.12

2 release files

0.1.11

2 release files

0.1.10

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

0.0.23

2 release files

0.0.21

2 release files

0.0.20

2 release files

0.0.19

2 release files

0.0.18

2 release files

0.0.17

2 release files

0.0.16

2 release files

0.0.15

2 release files

0.0.13

2 release files

0.0.12

2 release files

0.0.11

2 release files

0.0.10

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page