Skip to main content

A Python 3 library for automatically running experiments using a Slurm cluster

Project description

SlurmQueen

A Python 3 library for automatically running experiments on a black-box tool using a Slurm cluster. In particular, this harness allows you to:

  1. Define an experiment by declaring a list of tasks to run on a tool.
  2. Generate bash scripts that run each task.
  3. Run those bash scripts on a Slurm cluster and download the results.
  4. Analyze the results through an SQL interface.

See this jupyter notebook for detailed usage.

Installation

For most users, the recommended method to install is via pip:

pip install slurmqueen

Dependencies:

  • paramiko
  • pandas
  • pathlib (included in Python 3.4 or higher)
  • ipywidgets (optional)
  • notebook (required to run the example notebook)

See requirements.txt for detailed version information, if needed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

slurmqueen-1.6.3.tar.gz (14.4 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page