Skip to main content

A really simple job queue. Uses a rudimentary event loop and runs tasks in subprocesses (managed with signalfd). Doesn’t support task arguments. Task results are rudimentary (only succcess or failure with exit code). When multiple requests are made for the same task they are collapsed into a single request.

  • Free software: BSD 2-Clause License

Installation

pip install stampede

Documentation

To use the project:

import stampede


class MyWorker(StampedeWorker):

    def handle_task(self, name):
        print("Perfoming work for task:", name)

Development

To run the all tests run:

tox

Changelog

2.0.0 (2018-12-17)

  • Use more robust collection of child exit codes. Turns out that if there’s enough pressure of the signalfd is fills up and needs extra os.waitpid() calls to collect the orphans.

  • Add a request API (stampede.request).

  • Add a request API that also spawns the daemon if not running (stampede.request_and_spawn).

  • Changed do_work to handle_task in StampedeWorker. BACKWARDS INCOMPATIBLE

  • Update test grid to include Python 3.7 and PyPy3.

  • Changed how results are passed to the client (JSON instead of some crappy custom text format).

1.0.0 (2015-10-19)

0.0.1 (2013-10-30)

  • ?

0.0.1 (2013-10-28)

  • First release on PyPI.

Release files for stampede 2.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for stampede 2.0.0
File Size Uploaded
stampede-2.0.0.tar.gz 16.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for stampede 2.0.0
File Interpreter ABI Platform
stampede-2.0.0-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 25.4 kB

Release files / stampede-2.0.0.tar.gz

Download URL stampede-2.0.0.tar.gz
Size 16.9 kB
Tags Source
SHA-256 checksum
How to use checksums
26f5382e09e4ae5b058e6b913374922c67fafa8f3304244c9be712bada8f9215
BLAKE2b-256 checksum
How to use checksums
d422841b3a947c87323f48f636dfe709f9996bc86ba2c9a17dff18d7539bfb88
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.6

Release files / stampede-2.0.0-py2.py3-none-any.whl

Download URL stampede-2.0.0-py2.py3-none-any.whl
Size 8.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
c19f5c0da6f8c1e29bfe2b2d8966a2709d1a836e19e65b25ecd1c782afbecb39
BLAKE2b-256 checksum
How to use checksums
51039d08bb3cb8ec9d4e58010ee76710ec8fdd8bf782ebf2e37036bfdc242ae1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.4.2 requests/2.18.4 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.6

Release history Release notifications | RSS feed

This release

2.0.0 This release

2 release files

1.0.0

2 release files

0.0.2

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page