Skip to main content

Lightweight pipeline engine for LSST DESC

Project description

Ceci Logo

Ceci Pipeline Software

Continuous Integration Status Documentation Status Coverage Status PyPI Downloads

“Ceci n'est pas une pipeline.”

A lightweight parsl-based framework for running DESC pipelines.

This is now beta status.


pip install ceci

This installs the simplest version of ceci, if you want to be able to use the parsl backend, install instead ceci[parsl].

You can then run an example pipeline from the ceci_lib directory using:

ceci test/test.yml

Adding Pipeline Stages

To make new pipeline stages, you must:

  • make a new python package somewhere else, to contain your stages.
  • the package must have an file that should import from . all the stages you want to use.
  • it must also have a file with the same contents as the example in ceci_example.
  • each stage is its own class inheriting from ceci.PipelineStage. Each must define its name, inputs, and outputs, and a run method.
  • the run method should use the parent methods from PipelineStage to get its inputs and outputs etc.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for ceci, version 1.4.1
Filename, size File type Python version Upload date Hashes
Filename, size ceci-1.4.1.tar.gz (116.9 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page