submit hundreds of jobs to slurm automatically.
Project description
autosbatch
submit hundreds of jobs to slurm automatically
- Documentation: https://Jianhua-Wang.github.io/autosbatch
- GitHub: https://github.com/Jianhua-Wang/autosbatch
- PyPI: https://pypi.org/project/autosbatch/
- Free software: MIT
Features
Sometimes, it's quite inconvenient when we submit hundreds of jobs to slurm. For example, one needs to align RNA-seq data from one hundred samples. He may start with a bash script that takes the fastq of one sample and write sbatch scripts which execute bash align.sh sample.fq
multiple times. If he wants to run 50 samples at the same time, he should write 50 sbatch scripts and each script contains two align commands. Manually managing these sbatch scripts is inconvenient. autosbatch is very helpful for submitting slurm jobs automatically and it's just like the multiprocessing.Pool
.
- Automatically submit hundreds of jobs to Slurm with a few code.
- The same usage as
multiprocessing.Pool
. - Provide command line tool for people who are not familiar with Python.
TODO
- Support gpu allocation
- Support MPI jobs
Credits
This package was created with Cookiecutter and the waynerv/cookiecutter-pypackage project template.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file autosbatch-0.2.7.tar.gz
.
File metadata
- Download URL: autosbatch-0.2.7.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c0a487170d6c8174b781479db64084f7e2387e5726c78b571f9dce6db7463dd2 |
|
MD5 | 5cf984c72c4a8a5b6e51352a21bfcae3 |
|
BLAKE2b-256 | 22d53dfc4516f76f3e2ef497f92fd9ccd93ffe25dc8ae817445f99279c4dabf3 |
File details
Details for the file autosbatch-0.2.7-py3-none-any.whl
.
File metadata
- Download URL: autosbatch-0.2.7-py3-none-any.whl
- Upload date:
- Size: 9.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 47ec830b3b224d060a9a5edbcf906c98721c3c327220a8c1792ccce57707d1c9 |
|
MD5 | 3aae52169fd98d702898db339fbdab67 |
|
BLAKE2b-256 | 7149670088d6fcb0bec672bea1825ea65397e3981524069470b13eee66822de5 |