Skip to main content

dagster-soda

PyPI version

dagster-soda integrates Soda Core data quality checks with Dagster. It provides the SodaScanComponent, a Dagster component that runs Soda Core scans and maps SodaCL check results to Dagster asset checks.

Installation

pip install dagster-soda

Note: dagster-soda requires soda-core 3.x (the soda.scan API). It pins soda-core>=3.0,<4 by default.

Usage

Component: SodaScanComponent

Configure a SodaScanComponent in your Dagster project to:

  • Point at SodaCL YAML check files and a Soda configuration.yml
  • Map Soda dataset names to Dagster asset keys
  • Run scans and report pass/fail as Dagster asset check results

Scaffolding with the CLI

Use the Dagster CLI to scaffold a new Soda scan component in your project (requires dagster-dg-cli):

dg scaffold defs dagster_soda.SodaScanComponent <path>

Example (scaffold into a folder named soda_checks under your defs directory):

dg scaffold defs dagster_soda.SodaScanComponent soda_checks

This generates:

  • A defs.yaml with default attributes (checks_paths, configuration_path, data_source_name, asset_key_map)
  • A checks.yml template with example SodaCL (e.g. checks for my_table: - row_count > 0)

Edit the generated files to match your data source and checks, then load your definitions as usual.

Minimal defs.yaml example

type: dagster_soda.SodaScanComponent
attributes:
  checks_paths:
    - checks.yml
  configuration_path: configuration.yml
  data_source_name: my_datasource
  asset_key_map:
    my_table: my_table

Documentation

The docs for dagster-soda can be found here.

Release files for dagster-soda 0.29.24

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-soda 0.29.24
File Size Uploaded
dagster_soda-0.29.24.tar.gz 201.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-soda 0.29.24
File Interpreter ABI Platform
dagster_soda-0.29.24-py3-none-any.whl Python 3 none any Details

Total release size: 213.6 kB

Release files / dagster_soda-0.29.24.tar.gz

Download URL dagster_soda-0.29.24.tar.gz
Size 201.4 kB
Tags Source
SHA-256 checksum
How to use checksums
60d22747af460dbae16cec5629b9799644ce7135f18d47e19a9aef41c9f843a3
BLAKE2b-256 checksum
How to use checksums
62ecc6c1919a75b773ef5b0b44e8f446daeabce7b4a845e26071f8008e1fe69b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14

Release files / dagster_soda-0.29.24-py3-none-any.whl

Download URL dagster_soda-0.29.24-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3ed247ca36ff967dbf83cbc18d32153be1a80e9d4628860a051cb071daef184b
BLAKE2b-256 checksum
How to use checksums
912b0dfe03b6eab932bf6d703b10264eb0be529555e3df45a48ab3e473bfe66e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page