A Python 3 library for automatically running experiments using a Slurm cluster
Project description
# SlurmQueen
A Python 3 library for automatically running experiments on a black-box tool using a Slurm cluster.
In particular, this harness allows you to:
1. Define an experiment by declaring a list of tasks to run on a tool.
2. Generate bash scripts that run each task.
3. Run those bash scripts on a Slurm cluster and download the results.
4. Analyze the results through an SQL interface.
# Installation
For most users, the recommended method to install is via pip:
```
pip install slurmqueen
```
## Dependencies:
* paramiko
* pandas
* ipywidgets (optional)
* click (required on the Slurm cluster to run the example)
* notebook (required to run the example notebook)
A Python 3 library for automatically running experiments on a black-box tool using a Slurm cluster.
In particular, this harness allows you to:
1. Define an experiment by declaring a list of tasks to run on a tool.
2. Generate bash scripts that run each task.
3. Run those bash scripts on a Slurm cluster and download the results.
4. Analyze the results through an SQL interface.
# Installation
For most users, the recommended method to install is via pip:
```
pip install slurmqueen
```
## Dependencies:
* paramiko
* pandas
* ipywidgets (optional)
* click (required on the Slurm cluster to run the example)
* notebook (required to run the example notebook)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
slurmqueen-1.2.2.tar.gz
(11.7 kB
view hashes)
Built Distribution
slurmqueen-1.2.2-py3-none-any.whl
(16.1 kB
view hashes)
Close
Hashes for slurmqueen-1.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | feca5622c98a23058a5f2d4348fdbba334d0085af4d10a013adb5dc57bb894c9 |
|
MD5 | 5d47d57445fa5d5390b04a0431a7d2a0 |
|
BLAKE2b-256 | e7b908ed1ca7739c9ca96e41d1706a7b39849fb8e94ffa9580ae469b2164427f |