Skip to main content

dagster-soda

PyPI version

dagster-soda integrates Soda Core data quality checks with Dagster. It provides the SodaScanComponent, a Dagster component that runs Soda Core scans and maps SodaCL check results to Dagster asset checks.

Installation

pip install dagster-soda

Note: dagster-soda requires soda-core 3.x (the soda.scan API). It pins soda-core>=3.0,<4 by default.

Usage

Component: SodaScanComponent

Configure a SodaScanComponent in your Dagster project to:

  • Point at SodaCL YAML check files and a Soda configuration.yml
  • Map Soda dataset names to Dagster asset keys
  • Run scans and report pass/fail as Dagster asset check results

Scaffolding with the CLI

Use the Dagster CLI to scaffold a new Soda scan component in your project (requires dagster-dg-cli):

dg scaffold defs dagster_soda.SodaScanComponent <path>

Example (scaffold into a folder named soda_checks under your defs directory):

dg scaffold defs dagster_soda.SodaScanComponent soda_checks

This generates:

  • A defs.yaml with default attributes (checks_paths, configuration_path, data_source_name, asset_key_map)
  • A checks.yml template with example SodaCL (e.g. checks for my_table: - row_count > 0)

Edit the generated files to match your data source and checks, then load your definitions as usual.

Minimal defs.yaml example

type: dagster_soda.SodaScanComponent
attributes:
  checks_paths:
    - checks.yml
  configuration_path: configuration.yml
  data_source_name: my_datasource
  asset_key_map:
    my_table: my_table

Documentation

The docs for dagster-soda can be found here.

Release files for dagster-soda 0.29.23

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-soda 0.29.23
File Size Uploaded
dagster_soda-0.29.23.tar.gz 201.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-soda 0.29.23
File Interpreter ABI Platform
dagster_soda-0.29.23-py3-none-any.whl Python 3 none any Details

Total release size: 213.6 kB

Release files / dagster_soda-0.29.23.tar.gz

Download URL dagster_soda-0.29.23.tar.gz
Size 201.4 kB
Tags Source
SHA-256 checksum
How to use checksums
b9b56a214ca568a610e79f0e90fe0dd512e5720dfbddb3378f1674ecae517c6f
BLAKE2b-256 checksum
How to use checksums
be5ea806295cfd48009959929eed1ccf6c48ad227afd8a7f1c0b86f7b71b3c69
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14

Release files / dagster_soda-0.29.23-py3-none-any.whl

Download URL dagster_soda-0.29.23-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
30696d7dafec57270d8593631d42b52264489f2f5fb736b4911f9cc83ed92d2b
BLAKE2b-256 checksum
How to use checksums
0665af0ad076fa744773e17012c74cb20fc27f5635f0ac00bd87bc4f45a45c76
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page