Skip to main content

The workflow management system for scalable data analyses.

Project description

PBS-builder

A simplified version of workflow management system for scalable data analysis.

Change log

  • Version 0.4.7: consistent behaviour in mu02 and mu04
  • Version 0.4.6: add suport for escape character in variable names
  • Version 0.4.5: add progress bar and verbose output options
  • Version 0.4.4: add elapsed time for each job
  • Version 0.4.3: add support for non-BIOLS machines
  • Version 0.4.2: integrate pushover service
  • Version 0.4.1: auto-switch to corresponding pbs_server for qbatch
  • Version 0.4.0: merge qcancel into qbatch commands, change API
  • Version 0.3.1: add allocated/total gpus in pestat output
  • Version 0.3.0: include pestat in package data
  • Version 0.2.0: move sample_sheet from header to job section, add group_sheet support.
  • Version 0.1.0: first functional version.

Usage

pbs-builder include the following commands:

  1. qbatchfor batch submission of TORQUE/SLURM jobs

  2. pestat for monitoring cluster & nodes status

  3. pushover for get noficiations from compute nodes

Please refer to our wiki for detailed instructions.

Installation

pbs-builder runs in python3.7+ with the tomli package installed, no other dependencies are required.

Install pbs-builder using the following command:

pip install pbs-builder

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pbs_builder-0.4.8.tar.gz (19.9 kB view hashes)

Uploaded Source

Built Distribution

pbs_builder-0.4.8-py3-none-any.whl (20.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page