Skip to main content

satva

Satva is a data pipeline engine. This package runs the same YAML pipelines as the satva command-line tool.

Requires Python 3.9 or newer. Licensed under the MIT License.

Install

pip install satva

Usage

import satva

summary = satva.run("pipeline.yaml")
print(summary["processed"], summary["succeeded"], summary["skipped"], summary["failed"])

# Raises RuntimeError on the first record failure.
satva.run("pipeline.yaml", stop_on_error=True)

satva.run returns a dict with processed, succeeded, skipped, failed, and logs. logs is a list of strings. stop_on_error defaults to False: failed records are counted and the call returns. File paths inside the YAML config are relative to the process working directory.

source:
  type: json
  path: input.jsonl

sink:
  type: json
  path: output.jsonl

stages:
  - type: filter
    expression: 'active == true && salary >= 70000'
  - type: set_field
    field: bonus
    expression: 'salary * 0.15'

Sources and sinks: CSV, TSV, JSONL (json), JSON array (json_array), Parquet, and Excel. Pipeline and expression details are in the repository docs.

Metadata

Release files for satva 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for satva 0.1.0
File Size Uploaded
satva-0.1.0.tar.gz 83.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for satva 0.1.0
File Interpreter ABI Platform
satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.34+ x86-64 Details

Total release size: 5.9 MB

Release files / satva-0.1.0.tar.gz

Download URL satva-0.1.0.tar.gz
Size 83.2 kB
Tags Source
SHA-256 checksum
How to use checksums
54c283eb580c6c732c84a9af4c53bdb4b7c04ae35466178de006143f7eb55be2
BLAKE2b-256 checksum
How to use checksums
0d7dba240610133cc42e2148d78cf74c9a3db7577b584858b80c4c9e8765ad74
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.15.0

Release files / satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl

Download URL satva-0.1.0-cp314-cp314-manylinux_2_34_x86_64.whl
Size 5.8 MB
Tags CPython 3.14 Linux glibc 2.34+ x86-64
SHA-256 checksum
How to use checksums
fd728dd93ec0e2a925318d550139caa429271f488b46e652d01ff560a8ff5dfe
BLAKE2b-256 checksum
How to use checksums
14fb9662135fcc443969dcc31af16e07e2a43333ebfb1ffd194e2a1389144787
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.15.0

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page