MyQueue
MyQueue is a tool for submitting and keeping track of tasks running on a cluster of computers. It uses SLURM, PBS or LSF as a backend and makes handling of tasks easy. It has a command-line interface called mq with a number of sub-commands and a Python interface for managing workflows. Simple to set up: no system administrator or database required.
Quick links:
Documentation: https://myqueue.readthedocs.io/
Chat: https://matrix.to/#/#myqueue:matrix.org
Examples
Submit Python script to 32 cores for 2 hours:
$ mq submit script.py -R 32:2h
Submit Python module abc.run in two folders:
$ mq submit abc.run F1/ F2/ -R 16:30m
Check results of tasks in current folder and its sub-folders:
$ mq list # or mq ls id folder name res. age state time error --- ------ --------- ------ ------- ------- ------- ------ 117 ./ script.py 32:2h 5:28:43 TIMEOUT 2:00:03 118 ./F1/ abc.run 16:30m 5:22:16 done 12:12 119 ./F2/ abc.run 16:30m 5:22:16 done 17:50 --- ------ --------- ------ ------- ------- ------- ------ done: 2, TIMEOUT: 1, total: 3
Resubmit with more resources (1 day):
$ mq resubmit -i 117 -R 32:1d
See more examples of use here:
Installation
MyQueue needs Python version 3.9 or later.
Install MyQueue from PyPI with pip:
$ python3 -m pip install myqueue
This will also install the rich and networkx packages that MyQueue depends on.
Enable bash tab-completion for future terminal sessions like this:
$ mq completion >> ~/.profile
Now, configure your system as described here.
Release notes
See the release notes for a history of notable changes to MyQueue.
Help, support and feedback
If you need help, want to report a bug or suggest a new feature then you are welcome to get in touch via MyQueue’s issue tracker or the #myqueue room on Matrix.
Contributing
We welcome contributions to the code and documentation, preferably as merge-requests. More information here.
2 maintainers
Metadata
2 maintainers
Release files for myqueue 26.8.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| myqueue-26.8.1.tar.gz | 137.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| myqueue-26.8.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 248.8 kB
Release files / myqueue-26.8.1.tar.gz
| Download URL | myqueue-26.8.1.tar.gz |
|---|---|
| Size | 137.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7fd17518be0d36c1bbb81eaf703445f8a4c5e9792f338028bf5cdd432a4986fe
|
|
BLAKE2b-256 checksum How to use checksums |
07e0fa08dcae4c38b7a6ab486411d1cc85e5563848a770a2ac4c2fc9cf4e58b2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
Release files / myqueue-26.8.1-py3-none-any.whl
| Download URL | myqueue-26.8.1-py3-none-any.whl |
|---|---|
| Size | 110.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9b3d4e319c541108881e97f488cc535b83a707dc30c033efddb34214e5bd2e36
|
|
BLAKE2b-256 checksum How to use checksums |
face1bc4434ed0ba411bce36fead37f27e8f5c2e2a6ad028573f1f6266e326ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.3
|
