Uploads SLURM job information to WandB for better monitoring.
Project description
slurm-to-wandb
Monitor SLURM jobs using Weights and Biases (wandb) 📊
Usage
On your cluster, login to wandb using the cli, then run:
pip install slurm-to-wandb
slurm_to_wandb <job_ids>
... to upload all sacct
information to wandb. <job_ids>
can be multiple space-separated job ids. In the case multiple job id's match, all matched job ids are uploaded (useful, for example, when using job arrays).
To construct a DataFrame with the information yourself, run on the cluster:
from slurm_to_wandb import sacct_as_df
df = sacct_as_df(*<job_ids>)
df
You can now upload the information to wandb however you like 🙌🏻
About
By Jeroen Overschie.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
slurm_to_wandb-0.1.1.tar.gz
(4.6 kB
view hashes)
Built Distribution
Close
Hashes for slurm_to_wandb-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c1edf6a40f979fa919a1ea84f9f6cb1f9544fb4dcb587b1dda176b8e7640a94e |
|
MD5 | bff273a56702bc19b7a5a785d65e1434 |
|
BLAKE2b-256 | 0cce8f8399c8bfc49c5e06daf334a4a32585ff78cc63d05b125a2d008cc5579c |