A really simple job queue. Uses a rudimentary event loop and runs tasks in subprocesses (managed with signalfd). Doesn't support task arguments. Task results are rudimentary (only succcess or failure with exit code). When multiple requests are made for the same task they are collapsed into a single request.
Project description
A really simple job queue. Uses a rudimentary event loop and runs tasks in subprocesses (managed with signalfd). Doesn’t support task arguments. Task results are rudimentary (only succcess or failure with exit code). When multiple requests are made for the same task they are collapsed into a single request.
Free software: BSD 2-Clause License
Installation
pip install stampede
Documentation
To use the project:
import stampede
class MyWorker(StampedeWorker):
def handle_task(self, name):
print("Perfoming work for task:", name)
Development
To run the all tests run:
tox
Changelog
2.0.0 (2018-12-17)
Use more robust collection of child exit codes. Turns out that if there’s enough pressure of the signalfd is fills up and needs extra os.waitpid() calls to collect the orphans.
Add a request API (stampede.request).
Add a request API that also spawns the daemon if not running (stampede.request_and_spawn).
Changed do_work to handle_task in StampedeWorker. BACKWARDS INCOMPATIBLE
Update test grid to include Python 3.7 and PyPy3.
Changed how results are passed to the client (JSON instead of some crappy custom text format).
1.0.0 (2015-10-19)
Switch to signalfd (from the unmaintained python-signalfd).
Switch to pytest.
0.0.1 (2013-10-30)
?
0.0.1 (2013-10-28)
First release on PyPI.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file stampede-2.0.0.tar.gz
.
File metadata
- Download URL: stampede-2.0.0.tar.gz
- Upload date:
- Size: 16.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26f5382e09e4ae5b058e6b913374922c67fafa8f3304244c9be712bada8f9215 |
|
MD5 | 0e0dc5e4c74603278eda3a079d604161 |
|
BLAKE2b-256 | d422841b3a947c87323f48f636dfe709f9996bc86ba2c9a17dff18d7539bfb88 |
File details
Details for the file stampede-2.0.0-py2.py3-none-any.whl
.
File metadata
- Download URL: stampede-2.0.0-py2.py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c19f5c0da6f8c1e29bfe2b2d8966a2709d1a836e19e65b25ecd1c782afbecb39 |
|
MD5 | b9450b45c5a30a49eca21620a27c3ea5 |
|
BLAKE2b-256 | 51039d08bb3cb8ec9d4e58010ee76710ec8fdd8bf782ebf2e37036bfdc242ae1 |