slurmgen 0.3.0

SlurmGen - Simple Slurm Manager

SlurmGen - Simple Slurm Manager

• Repository: github.com/otvam/slurmgen
• Package: pypi.org/project/slurmgen

Summary

SlurmGen is a very simple Slurm manager:

• The job description is stored in a JSON file.
• The JSON file is transformed into a Slurm script.
• The Slurm file is submitted to the cluster.

SlurmGen is only supporting a small subset of Slurm:

• Create and delete folders.
• Set environment variables.
• Set the job name and log.
• Set the ressources (memory, time, CPU, etc.).
• Define the set of commands to be executed.

SlurmGen is not a binding and/or a wrapper for Slurm. SlurmGen is only generating Slurm scripts from JSON files. SlurmGen is written in Python without any external dependencies.

Example

An example is located in the example folder of the repository:

• test.json contains the Slurm job description
• run_slurm.py contains is dummy script executed by the jon
• slurm_output contains the generated Slurm script and log file
• 'data_output' contains data generated by the Slurm job

# Running this command will:
#   - Create a Slurm script "slurm_output/test.slm"
#   - Put the log file in "slurm_output/test.log"
#   - Run the Slurm script on the cluster
sgen test.json

Project Links

• Repository: https://github.com/otvam/slurmgen
• Releases: https://github.com/otvam/slurmgen/releases
• Tags: https://github.com/otvam/slurmgen/tags
• Issues: https://github.com/otvam/slurmgen/issues
• PyPi: https://pypi.org/project/slurmgen

Author

• Thomas Guillod
• Email: [e-mail]
• Website: https://otvam.ch

Copyright

(c) 2023 - Thomas Guillod - Dartmouth College

BSD 2-Clause "Simplified" License