Skip to main content

submit hundreds of jobs to slurm automatically.

Project description

autosbatch

pypi python Build Status codecov License: MIT PyPI download month

submit hundreds of jobs to slurm automatically

Features

Sometimes, it's quite inconvenient when we submit hundreds of jobs to slurm. For example, one needs to align RNA-seq data from one hundred samples. He may start with a bash script that takes the fastq of one sample and write sbatch scripts which execute bash align.sh sample.fq multiple times. If he wants to run 50 samples at the same time, he should write 50 sbatch scripts and each script contains two align commands. Manually managing these sbatch scripts is inconvenient. autosbatch is very helpful for submitting slurm jobs automatically and it's just like the multiprocessing.Pool.

  • Automatically submit hundreds of jobs to Slurm with a few code.
  • The same usage as multiprocessing.Pool.
  • Provide command line tool for people who are not familiar with Python.

TODO

  • Support gpu allocation
  • Support MPI jobs

Credits

This package was created with Cookiecutter and the waynerv/cookiecutter-pypackage project template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autosbatch-0.2.7.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

autosbatch-0.2.7-py3-none-any.whl (9.8 kB view details)

Uploaded Python 3

File details

Details for the file autosbatch-0.2.7.tar.gz.

File metadata

  • Download URL: autosbatch-0.2.7.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.5

File hashes

Hashes for autosbatch-0.2.7.tar.gz
Algorithm Hash digest
SHA256 c0a487170d6c8174b781479db64084f7e2387e5726c78b571f9dce6db7463dd2
MD5 5cf984c72c4a8a5b6e51352a21bfcae3
BLAKE2b-256 22d53dfc4516f76f3e2ef497f92fd9ccd93ffe25dc8ae817445f99279c4dabf3

See more details on using hashes here.

File details

Details for the file autosbatch-0.2.7-py3-none-any.whl.

File metadata

  • Download URL: autosbatch-0.2.7-py3-none-any.whl
  • Upload date:
  • Size: 9.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.5

File hashes

Hashes for autosbatch-0.2.7-py3-none-any.whl
Algorithm Hash digest
SHA256 47ec830b3b224d060a9a5edbcf906c98721c3c327220a8c1792ccce57707d1c9
MD5 3aae52169fd98d702898db339fbdab67
BLAKE2b-256 7149670088d6fcb0bec672bea1825ea65397e3981524069470b13eee66822de5

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page