Skip to main content

dagster-soda

PyPI version

dagster-soda integrates Soda Core data quality checks with Dagster. It provides the SodaScanComponent, a Dagster component that runs Soda Core scans and maps SodaCL check results to Dagster asset checks.

Installation

pip install dagster-soda

Note: dagster-soda requires soda-core 3.x (the soda.scan API). It pins soda-core>=3.0,<4 by default.

Usage

Component: SodaScanComponent

Configure a SodaScanComponent in your Dagster project to:

  • Point at SodaCL YAML check files and a Soda configuration.yml
  • Map Soda dataset names to Dagster asset keys
  • Run scans and report pass/fail as Dagster asset check results

Scaffolding with the CLI

Use the Dagster CLI to scaffold a new Soda scan component in your project (requires dagster-dg-cli):

dg scaffold defs dagster_soda.SodaScanComponent <path>

Example (scaffold into a folder named soda_checks under your defs directory):

dg scaffold defs dagster_soda.SodaScanComponent soda_checks

This generates:

  • A defs.yaml with default attributes (checks_paths, configuration_path, data_source_name, asset_key_map)
  • A checks.yml template with example SodaCL (e.g. checks for my_table: - row_count > 0)

Edit the generated files to match your data source and checks, then load your definitions as usual.

Minimal defs.yaml example

type: dagster_soda.SodaScanComponent
attributes:
  checks_paths:
    - checks.yml
  configuration_path: configuration.yml
  data_source_name: my_datasource
  asset_key_map:
    my_table: my_table

Documentation

The docs for dagster-soda can be found here.

Release files for dagster-soda 0.29.22

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-soda 0.29.22
File Size Uploaded
dagster_soda-0.29.22.tar.gz 201.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-soda 0.29.22
File Interpreter ABI Platform
dagster_soda-0.29.22-py3-none-any.whl Python 3 none any Details

Total release size: 213.6 kB

Release files / dagster_soda-0.29.22.tar.gz

Download URL dagster_soda-0.29.22.tar.gz
Size 201.5 kB
Tags Source
SHA-256 checksum
How to use checksums
fd3a03d5f75581e648af74e9cfb549c0c84eb30f6bde124bc660fccba87b779b
BLAKE2b-256 checksum
How to use checksums
d2a34bd503ad4e66fb74c592060c4a7d59bdfc40398287955e8f51f497e60784
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14

Release files / dagster_soda-0.29.22-py3-none-any.whl

Download URL dagster_soda-0.29.22-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fa090f79cd94ba44969ff5027747b52d47e09078fc98b0f45b71715b7254175c
BLAKE2b-256 checksum
How to use checksums
fcce80907ffed8df430fe3122604324a2fb91c77fdafa6c30654052b5ee2b1fe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page