Skip to main content

dagster-soda

PyPI version

dagster-soda integrates Soda Core data quality checks with Dagster. It provides the SodaScanComponent, a Dagster component that runs Soda Core scans and maps SodaCL check results to Dagster asset checks.

Installation

pip install dagster-soda

Note: dagster-soda requires soda-core 3.x (the soda.scan API). It pins soda-core>=3.0,<4 by default.

Usage

Component: SodaScanComponent

Configure a SodaScanComponent in your Dagster project to:

  • Point at SodaCL YAML check files and a Soda configuration.yml
  • Map Soda dataset names to Dagster asset keys
  • Run scans and report pass/fail as Dagster asset check results

Scaffolding with the CLI

Use the Dagster CLI to scaffold a new Soda scan component in your project (requires dagster-dg-cli):

dg scaffold defs dagster_soda.SodaScanComponent <path>

Example (scaffold into a folder named soda_checks under your defs directory):

dg scaffold defs dagster_soda.SodaScanComponent soda_checks

This generates:

  • A defs.yaml with default attributes (checks_paths, configuration_path, data_source_name, asset_key_map)
  • A checks.yml template with example SodaCL (e.g. checks for my_table: - row_count > 0)

Edit the generated files to match your data source and checks, then load your definitions as usual.

Minimal defs.yaml example

type: dagster_soda.SodaScanComponent
attributes:
  checks_paths:
    - checks.yml
  configuration_path: configuration.yml
  data_source_name: my_datasource
  asset_key_map:
    my_table: my_table

Documentation

The docs for dagster-soda can be found here.

Release files for dagster-soda 0.29.21

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-soda 0.29.21
File Size Uploaded
dagster_soda-0.29.21.tar.gz 201.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-soda 0.29.21
File Interpreter ABI Platform
dagster_soda-0.29.21-py3-none-any.whl Python 3 none any Details

Total release size: 213.6 kB

Release files / dagster_soda-0.29.21.tar.gz

Download URL dagster_soda-0.29.21.tar.gz
Size 201.5 kB
Tags Source
SHA-256 checksum
How to use checksums
2a8611490e6b1cc927fa59b67d94e8ac9e1fc834f5b962be8a568f7dc2739247
BLAKE2b-256 checksum
How to use checksums
2ffe68321d214f62d9b5003d1b4cd13c8728a7c4cd5ed3b31ebed6504df32fca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14

Release files / dagster_soda-0.29.21-py3-none-any.whl

Download URL dagster_soda-0.29.21-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f6417b9597730c9093ba76ab38aa8ec1a3cdd02418eceb9e2d6dbe96163182b8
BLAKE2b-256 checksum
How to use checksums
93186a523079d74b091914810788df82e13ab8a5d8a588e1e8bbb173433ce99c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page