What is this?
Pipestat standardizes reporting of pipeline results. It provides 1) a standard specification for how pipeline outputs should be stored; and 2) an implementation to easily write results to that format from within Python or from the command line.
How does it work?
A pipeline author defines all the outputs produced by a pipeline by writing a JSON-schema. The pipeline then uses pipestat to report pipeline outputs as the pipeline runs, either via the Python API or command line interface. The user configures results to be stored either in a YAML-formatted file or a PostgreSQL database. The results are recorded according to the pipestat specification, in a standard, pipeline-agnostic way. This way, downstream software can use this specification to create universal tools for analyzing, monitoring, and visualizing pipeline results that will work with any pipeline or workflow.
Quick start
Install pipestat
pip install pipestat
Set environment variables (optional)
export PIPESTAT_RESULTS_SCHEMA=output_schema.yaml
export PIPESTAT_RECORD_ID=my_record
export PIPESTAT_RESULTS_FILE=results_file.yaml
export PIPESTAT_NAMESPACE=my_namespace
Report a result
From command line:
pipestat report -i result_name -v 1.1
From Python:
import pipestat
psm = pipestat.PipestatManager()
psm.report(values={"result_name": 1.1})
Retrieve a result
From command line:
pipestat retrieve -i result_name
From Python:
import pipestat
psm = pipestat.PipestatManager()
psm.retrieve(result_identifier="result_name")
3 maintainers
Metadata
3 maintainers
Release files for pipestat 0.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pipestat-0.0.2.tar.gz | 20.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pipestat-0.0.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 42.4 kB
Release files / pipestat-0.0.2.tar.gz
| Download URL | pipestat-0.0.2.tar.gz |
|---|---|
| Size | 20.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
469ff52df387b1190ad3c8f8d84ff90b490daa393214cb18137ee4f7de642f66
|
|
BLAKE2b-256 checksum How to use checksums |
50e2f8949ffa7827805c0e2e434b89fea9bb6c4214b9df861eb10d4f5bbd9ced
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1
|
Release files / pipestat-0.0.2-py3-none-any.whl
| Download URL | pipestat-0.0.2-py3-none-any.whl |
|---|---|
| Size | 21.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9a7716ec43e78f85d23289e25914a2f036f84293284b338c2f6a505dc84f2603
|
|
BLAKE2b-256 checksum How to use checksums |
0031325d5e5a3a67b5b2a98b12c78ed48670982f24a3f8ed350b285ce15a7a7d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1
|
