Skip to main content

slurmwatch

Live per-process CPU / memory / GPU telemetry for a running Slurm job — the facts, so you can judge.

CI PyPI Python 3.10+ MIT License Ruff

slurmwatch live TUI: per-process CPU / memory / GPU bars, a JOB provenance card, and a wall-clock time-budget bar, with the alarm strip lighting up as memory climbs toward the OOM guard.

See whether your running job is actually using the CPU, memory, and GPUs you requested — live, in your terminal.

Install

pip install slurmwatch      # or: uv tool install slurmwatch / pipx install slurmwatch

Python 3.10+ on Linux (cgroup v1/v2). GPU monitoring auto-activates on NVIDIA nodes, and is skipped on CPU-only ones.

Usage

slurmwatch 12345    # watch a specific job
slurmwatch          # or auto-discover your running job
sw 12345            # "sw" is a short alias
slurmwatch --help   # everything else

Keysc/m/g drill into CPU / memory / GPU · type a node number (or /) to switch node · p expand a truncated path · q back/quit.

It counts only your PIDs (a neighbour on a shared node never inflates your numbers), tracks the real working set against your --mem, and flags an idle GPU that's still holding VRAM — the stuff nvidia-smi and htop won't tell you about your job.

Point it at a pending job and, instead of an error, you get why it's waiting, when it'll start and where you sit in line, and where it could run right now — with the exact scontrol update to requeue into a partition that fits.

Run it from a login node or on the node itself — it attaches either way, and falls back to an sstat summary when it can't.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

slurmwatch-0.9.3.tar.gz (4.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

slurmwatch-0.9.3-py3-none-any.whl (141.5 kB view details)

Uploaded Python 3

File details

Details for the file slurmwatch-0.9.3.tar.gz.

File metadata

  • Download URL: slurmwatch-0.9.3.tar.gz
  • Upload date:
  • Size: 4.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for slurmwatch-0.9.3.tar.gz
Algorithm Hash digest
SHA256 f317b1d4174dcddf1d1ed5fc5ab1cff6349d994ca6b1f03272bf459ec6eafec9
MD5 c08377affabece220ded4b4021a4ce9b
BLAKE2b-256 54a8bf7f90bf26ab668b4a1228d2647f7fff9c89a53e0abe13226d5e4358e8cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for slurmwatch-0.9.3.tar.gz:

Publisher: release.yml on PursuitOfDataScience/slurmwatch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file slurmwatch-0.9.3-py3-none-any.whl.

File metadata

  • Download URL: slurmwatch-0.9.3-py3-none-any.whl
  • Upload date:
  • Size: 141.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for slurmwatch-0.9.3-py3-none-any.whl
Algorithm Hash digest
SHA256 bf351878619e4d87c65f24a49cf7d551938ca1dabb7305d55a8061e9c97429a1
MD5 08193ba83a04031f9c8c213cf3d12c81
BLAKE2b-256 5ccb186884a61f36814b39d1b216ed22edd7843bccc39b86b588ea08bc97880b

See more details on using hashes here.

Provenance

The following attestation bundles were made for slurmwatch-0.9.3-py3-none-any.whl:

Publisher: release.yml on PursuitOfDataScience/slurmwatch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

1.1.1

2 files

1.1.0

2 files

1.0.1

2 files

1.0.0

2 files

0.10.1

2 files

0.10.0

2 files

0.9.9

2 files

0.9.8

2 files

0.9.7

2 files

0.9.6

2 files

0.9.5

2 files

0.9.4

2 files

This release

0.9.3 This release

2 files

0.9.2

2 files

0.9.1

2 files

0.9.0

2 files

0.8.2

2 files

0.8.1

2 files

0.8.0

2 files

0.7.0

2 files

0.6.0

2 files

0.5.0

2 files

0.4.0

2 files

0.3.0

2 files

0.2.3

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page