MyQueue
MyQueue is a tool for submitting and keeping track of tasks running on a cluster of computers. It uses SLURM, PBS or LSF as a backend and makes handling of tasks easy. It has a command-line interface called mq with a number of sub-commands and a Python interface for managing workflows. Simple to set up: no system administrator or database required.
Quick links:
Documentation: https://myqueue.readthedocs.io/
Chat: https://matrix.to/#/#myqueue:matrix.org
Examples
Submit Python script to 32 cores for 2 hours:
$ mq submit script.py -R 32:2h
Submit Python module abc.run in two folders:
$ mq submit abc.run F1/ F2/ -R 16:30m
Check results of tasks in current folder and its sub-folders:
$ mq list # or mq ls id folder name res. age state time error --- ------ --------- ------ ------- ------- ------- ------ 117 ./ script.py 32:2h 5:28:43 TIMEOUT 2:00:03 118 ./F1/ abc.run 16:30m 5:22:16 done 12:12 119 ./F2/ abc.run 16:30m 5:22:16 done 17:50 --- ------ --------- ------ ------- ------- ------- ------ done: 2, TIMEOUT: 1, total: 3
Resubmit with more resources (1 day):
$ mq resubmit -i 117 -R 32:1d
See more examples of use here:
Installation
MyQueue has only one dependency: Python version 3.6 or later.
Install MyQueue from PyPI with pip:
$ python3 -m pip install myqueue
Enable bash tab-completion for future terminal sessions like this:
$ mq completion >> ~/.profile
Now, configure your system as described here.
Release notes
See the release notes for a history of notable changes to MyQueue.
Help, support and feedback
If you need help, want to report a bug or suggest a new feature then you are welcome to get in touch via MyQueue’s issue tracker or the #myqueue room on Matrix.
Contributing
We welcome contributions to the code and documentation, preferably as merge-requests. More information here.
2 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file myqueue-21.4.0.tar.gz.
File metadata
- Download URL: myqueue-21.4.0.tar.gz
- Upload date:
- Size: 62.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a2ca186a3df4b08b60ae5c2ed16a5b9fe3217b6c75e7f705c506f2ce2a27dfaa
|
|
| MD5 |
63040ffe52df1d0ae7f324b9e0a5ec79
|
|
| BLAKE2b-256 |
028297c1967d5ddfabf77d83d16a7006382eaa71daafb25f7ca071826154e72f
|
File details
Details for the file myqueue-21.4.0-py3-none-any.whl.
File metadata
- Download URL: myqueue-21.4.0-py3-none-any.whl
- Upload date:
- Size: 78.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
16b33386e0e59c999f5125305185458856d769c0095d75e17b612c4162152e56
|
|
| MD5 |
f6aacce45776a690f4c9a0ab5bd9f55c
|
|
| BLAKE2b-256 |
fea031f4ef32a89f6a570b5d20c29ba2e38e1428313a287f57e7373fae5d1b41
|
