slurmit

This project is work in progress

A minimalistic reimplementation of submitit for Slurm.

Features

• Submit Python functions to SLURM
• Configure SLURM job parameters through templates
• Handle SLURM and runtime errors
• Retrieve job results

Installation

hatch create env

or

pip install -U -e .

Usage

Prepare template

#!/bin/bash

#SBATCH --nodes=1
#SBATCH --partition={partition}
#SBATCH --gres=gpu:{num_gpu}

module load cuda

Run the following script

from slurmit import SlurmExecutor


def add(x, y):
    return x + y


ex = SlurmExecutor("slurm_outputs",
                   "template.sh",
                   dict(partition="main", num_gpu=1))
job = ex.submit(add, 1, y=2)
print(job.result())  # 3