satva
Satva is a data pipeline engine. This package runs the same YAML pipelines as the satva command-line tool.
Requires Python 3.9 or newer. Licensed under the MIT License.
Install
pip install satva
Usage
import satva
summary = satva.run("pipeline.yaml")
print(summary["processed"], summary["succeeded"], summary["skipped"], summary["failed"])
# Raises RuntimeError on the first record failure.
satva.run("pipeline.yaml", stop_on_error=True)
satva.run returns a dict with processed, succeeded, skipped, failed, and logs. logs is a list of strings. stop_on_error defaults to False: failed records are counted and the call returns. File paths inside the YAML config are relative to the process working directory.
source:
type: json
path: input.jsonl
sink:
type: json
path: output.jsonl
stages:
- type: filter
expression: 'active == true && salary >= 70000'
- type: set_field
field: bonus
expression: 'salary * 0.15'
Sources and sinks: CSV, TSV, JSONL (json), JSON array (json_array), Parquet, and Excel. Pipeline and expression details are in the repository docs.
Metadata
Release files for satva 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| satva-0.1.0.tar.gz | 83.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl | CPython 3.14 | CPython 3.14 | Linux glibc 2.34+ x86-64 | Details |
Total release size: 5.9 MB
Release files / satva-0.1.0.tar.gz
| Download URL | satva-0.1.0.tar.gz |
|---|---|
| Size | 83.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
54c283eb580c6c732c84a9af4c53bdb4b7c04ae35466178de006143f7eb55be2
|
|
BLAKE2b-256 checksum How to use checksums |
0d7dba240610133cc42e2148d78cf74c9a3db7577b584858b80c4c9e8765ad74
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.15.0
|
Release files / satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl
| Download URL | satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl |
|---|---|
| Size | 5.8 MB |
| Tags | CPython 3.14 Linux glibc 2.34+ x86-64 |
|
SHA-256 checksum How to use checksums |
fd728dd93ec0e2a925318d550139caa429271f488b46e652d01ff560a8ff5dfe
|
|
BLAKE2b-256 checksum How to use checksums |
14fb9662135fcc443969dcc31af16e07e2a43333ebfb1ffd194e2a1389144787
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.15.0
|