picopipe
A small pipeline framework built on top of functions
An article describing development and use of picopipe: Towards Data Science: The Worlds Smallest Data Pipeline Framework
Installation
pip install picopipe
Examples
def add1(value):
return value + 1
def add2(value):
return value + 2
def add3(value):
return value + 3
from picopipe import pipeline
p = pipeline(add1, add2, add3)
p([10, 20, 30])
See tests for more examples.
Visualization
with open("pipeline.mmd", "w") as fp:
fp.write(to_mermaid(p))
Mermaid file (renders in github):
flowchart
subgraph pipeline_98e33e0628b546268abb2af5f74e50f1 ["pipeline"]
end
subgraph pipeline_205813c806fd4b37b40309497768f7c1 ["pipeline"]
node0["identity"]
node1["is_not_none"]
node2["identity"]
end
node0 --> node1
node1 --> node2
click node0 console.log "def identity(value):<br/>    return value<br/>"
click node1 console.log "@pfilter<br/>def is_not_none(v):<br/>    return v is not None<br/>"
click node2 console.log "def identity(value):<br/>    return value<br/>"
subgraph pipeline_d2f205ef957a428abbaa208241125819 ["pipeline"]
node3["add1"]
node4["[lambda]"]
end
node3 --> node4
click node3 console.log "def add1(value):<br/>    return value + 1<br/>"
click node4 console.log "lambda ...: ..."
pipeline_98e33e0628b546268abb2af5f74e50f1 --> pipeline_205813c806fd4b37b40309497768f7c1
pipeline_205813c806fd4b37b40309497768f7c1 --> pipeline_d2f205ef957a428abbaa208241125819
Metadata
Release files for picopipe 1.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| picopipe-1.0.2-py3-none-any.whl | Python 3 | none | any | Details for picopipe-1.0.2-py3-none-any.whl |
Release files / picopipe-1.0.2-py3-none-any.whl
| Download URL | picopipe-1.0.2-py3-none-any.whl |
|---|---|
| Size | 8.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
eafc6eff96f45d11253d862ab9956bb13f69d5a08c4caea8587fa67444f3be62
|
|
BLAKE2b-256 checksum How to use checksums |
d0544bd565bc0930ce6998a500d53ef6c7a03d31ed89df9702cbac1bfabade7e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.13
|
Security for picopipe 1.0.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.