Pivot: High-Performance Python Pipeline Tool

Change your code. Pivot knows what to run.

Pivot is a Python pipeline tool with automatic code change detection. Stages are plain Python functions; you wire them together by calling them inside a Pipeline block, and Pivot works out what needs to re-run.

Automatic code change detection using Python introspection
No paths in pipeline code: Pivot chooses where every output is stored
Per-stage lock files for fast parallel writes
Warm worker pools with preloaded imports
Content-addressable caching with S3 remote storage

Python: 3.13+ | Platform: Unix (Linux/macOS)

Quick Start

pip install pivot
mkdir my_project && cd my_project
git init && pivot init

Put a raw input under data/raw/:

mkdir -p data/raw
printf 'name,value\nalice,100\nbob,200\ncarol,\n' > data/raw/records.csv

Define stages and the pipeline in pipeline.py:

# pipeline.py
import pandas as pd

from pivot import Pipeline, StageParams, stage


class CleanParams(StageParams):
    min_value: int = 0


@stage
def clean(records: pd.DataFrame, params: CleanParams) -> pd.DataFrame:
    kept = records.dropna()
    return kept[kept["value"] >= params.min_value]


@stage
def summarize(rows: pd.DataFrame) -> dict:
    return {"count": len(rows), "total": int(rows["value"].sum())}


with Pipeline("demo") as pipeline:
    records = pipeline.input("records.csv")
    cleaned = clean(records, params=CleanParams(min_value=50))
    summarize(cleaned)

Then run it; Pivot resolves the DAG from the handles passed between stages:

pivot repro           # runs clean, then summarize
pivot repro           # nothing changed: both stages are cached
pivot repro --watch   # re-run automatically on file changes

Pivot writes outputs to data/demo/clean.jsonl and data/demo/summarize.yaml.

Learn More

Documentation
Source code
Interactive TUI: pip install pivot[tui], then pivot repro --tui

Metadata

Release files for pivot 0.3.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pivot 0.3.7
File	Size	Uploaded
pivot-0.3.7.tar.gz	324.6 kB	Oct 18, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for pivot 0.3.7
File	Interpreter	ABI	Platform	Reset
pivot-0.3.7-py3-none-any.whl 377.3 kB Oct 18, 2026	Python 3	none	any	Details

Total release size: 701.9 kB

Release files / pivot-0.3.7.tar.gz

Download URL	pivot-0.3.7.tar.gz
Size	324.6 kB
Tags	Source
SHA-256 checksum How to use checksums	`1966756c952b4a30be0e85e99c2c7f6c68df3dcf0f0ea0c9c5a1e1115223e073`
BLAKE2b-256 checksum How to use checksums	`a43e72fda622d57a852d244ebd0327a5fe9972c6ba964d36bbc98b6e20fa71ed`
Upload date	Oct 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.9.18 {"installer":{"name":"uv","version":"0.9.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Release files / pivot-0.3.7-py3-none-any.whl

Download URL	pivot-0.3.7-py3-none-any.whl
Size	377.3 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`d6c32d5b49d7186f021962e18d46188d161e242e4158ea63b4a4300f95404f8d`
BLAKE2b-256 checksum How to use checksums	`212b27d08e09d20c8e9c90c86d49a09d8ec483b25d1620f78977d60a132397be`
Upload date	Oct 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.9.18 {"installer":{"name":"uv","version":"0.9.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`