Skip to main content

Runtime-configured execution pipeline built on celery.

Project description

Execution pipeline built on celery, packages as a django app.


The full documentation is at


Install Pipeline:

pip install pipeline

Then use it in a project:

import pipeline


  • TODO

Notes: - Tasks return a taskResult for a reason; we need a awy to determine if the task has been called in a chain with mutable or immutable signature. If mutable, then the first param to the function will be the return value of the last function. We want to capture this scenario to update internal state table with that result in order to make it available to tasks without requiring a change to the task function signature. In this way we can write task functions that do not need to be aware of it they are being executed in a chain or not. In order to make it available, we will pop it off in PipelineTask.__call__ and add it as an instance variable to the task. (the ony way to do this is to look at the type of arg 0, and if it’s the same type that we ask tasks to return, then we know we are a mutable signature in a chain).

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

celery-pipeline-0.7.1.tar.gz (26.9 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page