Skip to main content

A tiny, typed, sequential pipeline engine for Python

Project description

lilpipe

A tiny, typed, sequential pipeline engine for Python.

PyPI Python Version CI Coverage License Binder

lilpipe is a lightweight, Pydantic-powered library for building and running sequential workflows in Python. It’s ideal for data processing, scientific workflows, and any task that benefits from a clear, linear sequence of steps. With built-in caching and simple control signals, lilpipe is small, typed, and practical.

Features

  • Sequential workflows — run steps in a fixed order.
  • Type-safe context — Pydantic-based PipelineContext.
  • Smart cachingfingerprint_keys to skip unchanged work.
  • Flow controlctx.abort_pass() and ctx.abort_pipeline().
  • Composable steps — nest via Step(name, children=[...]).
  • Tiny surface area — minimal API and dependencies.

Installation

pip install lilpipe

See pyproject.toml for supported Python versions.

Example Notebook

Run the full demo notebook live on Binder: Binder

(If you’d rather just view it, the raw notebook is at examples/example.ipynb in the repo.)

License

Licensed under the Apache 2.0 License.

Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lilpipe-0.1.5.tar.gz (8.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lilpipe-0.1.5-py3-none-any.whl (13.5 kB view details)

Uploaded Python 3

File details

Details for the file lilpipe-0.1.5.tar.gz.

File metadata

  • Download URL: lilpipe-0.1.5.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lilpipe-0.1.5.tar.gz
Algorithm Hash digest
SHA256 2965bbc0ef0569afc29524406b37dc98a101e288a55ad4cf433d9c92bb45e742
MD5 94bc2d871b0c6598ec7418a5ee3cb6f0
BLAKE2b-256 4ecb36deeb386089be9577946d7718595e79ec7df0d659326270bb321db4ba69

See more details on using hashes here.

File details

Details for the file lilpipe-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: lilpipe-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 13.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lilpipe-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 d9b2ddc811ec4d6018cef430dcc2e3ba5426c14914b0e54b17c3461c8d262b5e
MD5 576036e03ab2e041391d619d8096ae59
BLAKE2b-256 d2ff8d7e3d3a23b8eef553f3c0cf39d27b422448573c0772315a2cb7148bebf1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page