Skip to main content

Pivot: High-Performance Python Pipeline Tool

Change your code. Pivot knows what to run.

Pivot is a Python pipeline tool with automatic code change detection. Stages are plain Python functions; you wire them together by calling them inside a Pipeline block, and Pivot works out what needs to re-run.

  • Automatic code change detection using Python introspection
  • No paths in pipeline code: Pivot chooses where every output is stored
  • Per-stage lock files for fast parallel writes
  • Warm worker pools with preloaded imports
  • Content-addressable caching with S3 or Google Cloud Storage remotes

Python: 3.13+ | Platform: Unix (Linux/macOS)

Quick Start

pip install pivot
mkdir my_project && cd my_project
git init && pivot init

Put a raw input under data/raw/:

mkdir -p data/raw
printf 'name,value\nalice,100\nbob,200\ncarol,\n' > data/raw/records.csv

Define stages and the pipeline in pipeline.py:

# pipeline.py
import pandas as pd

from pivot import Pipeline, StageParams, stage


class CleanParams(StageParams):
    min_value: int = 0


@stage
def clean(records: pd.DataFrame, params: CleanParams) -> pd.DataFrame:
    kept = records.dropna()
    return kept[kept["value"] >= params.min_value]


@stage
def summarize(rows: pd.DataFrame) -> dict:
    return {"count": len(rows), "total": int(rows["value"].sum())}


with Pipeline("demo") as pipeline:
    records = pipeline.input("records.csv")
    cleaned = clean(records, params=CleanParams(min_value=50))
    summarize(cleaned)

Then run it; Pivot resolves the DAG from the handles passed between stages:

pivot repro           # runs clean, then summarize
pivot repro           # nothing changed: both stages are cached
pivot repro --watch   # re-run automatically on file changes

Pivot writes outputs to data/demo/clean.jsonl and data/demo/summarize.yaml.

Learn More

Metadata

Release files for pivot 0.5.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pivot 0.5.8
File Size Uploaded Provenance
pivot-0.5.8.tar.gz 372.6 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for pivot 0.5.8
File Interpreter ABI Platform
pivot-0.5.8-py3-none-any.whl Python 3 none any Details

Total release size: 802.5 kB

Release files / pivot-0.5.8.tar.gz

Download URL pivot-0.5.8.tar.gz
Size 372.6 kB
Tags Source
SHA-256 checksum
How to use checksums
1080edddf940e90bc68ec83c83c2629a1dd202756f940a4b4169bf85b42c3736
BLAKE2b-256 checksum
How to use checksums
b4f4563f0ab527ecf525194679419941ebfa06c876cb12fdcb5b9a94c526cf8b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.9.18 {"installer":{"name":"uv","version":"0.9.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / pivot-0.5.8-py3-none-any.whl

Download URL pivot-0.5.8-py3-none-any.whl
Size 429.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e05809359c119ff50a2f763bca9e962160fc22c557529adbe37f759c99f8ebd8
BLAKE2b-256 checksum
How to use checksums
e9fbf5494a9689c8ba2733a4043577304e552b3d930977bae5e9f8e438fe69ab
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.9.18 {"installer":{"name":"uv","version":"0.9.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for pivot 0.5.8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.5.8 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page