Skip to main content

A Python 3 library for automatically running experiments using a Slurm cluster

Project description

SlurmQueen

A Python 3 library for automatically running experiments on a black-box tool using a Slurm cluster. In particular, this harness allows you to:

  1. Define an experiment by declaring a list of tasks to run on a tool.
  2. Generate bash scripts that run each task.
  3. Run those bash scripts on a Slurm cluster and download the results.
  4. Analyze the results through an SQL interface.

Installation

For most users, the recommended method to install is via pip:

pip install slurmqueen

Dependencies:

  • paramiko
  • pandas
  • ipywidgets (optional)
  • click (required on the Slurm cluster to run the example)
  • notebook (required to run the example notebook)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

slurmqueen-1.2.1.tar.gz (11.7 kB view details)

Uploaded Source

File details

Details for the file slurmqueen-1.2.1.tar.gz.

File metadata

  • Download URL: slurmqueen-1.2.1.tar.gz
  • Upload date:
  • Size: 11.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.2 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for slurmqueen-1.2.1.tar.gz
Algorithm Hash digest
SHA256 2543b68e86e32eb07af5e1ce0cbda0040d3118fa7079b57aae5bb3e098d9efb4
MD5 18b659242c203c330615e47701e9dc7d
BLAKE2b-256 0918b1cbfc6ec3e2d38e5bf805403231073b7e5fd8040d9f41a9097785015ac7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page