A pipeline orchestration layer built on top of prefect for caching and cache invalidation to SQL and blob store targets.
Project description
pydiverse.pipedag
A pipeline orchestration layer built on top of prefect for caching and cache invalidation to SQL and blob store targets.
Installation
You can install the package in development mode using:
git clone https://github.com/pydiverse/pydiverse.pipedag.git
cd pydiverse.pipedag
# create and activate a fresh environment named pydiverse.pipedag
# see environment.yml for details
mamba env create
conda activate pydiverse.pipedag
pre-commit install
pip install --no-build-isolation -e .
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pydiverse.pipedag-0.0.1-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3aed35d563f9a9cd12398cf197c06a3823694f2bb78bae1b9896c5de93659408 |
|
| MD5 | 241bf34dacbe1b7668e8ad0dde8f21b3 |
|
| BLAKE2b-256 | 669d32fdf2e417c8926fe70cfa942724c0f020270e2ba34b537d7e03ce6fdb27 |
