Skip to main content

dagster-soda

PyPI version

dagster-soda integrates Soda Core data quality checks with Dagster. It provides the SodaScanComponent, a Dagster component that runs Soda Core scans and maps SodaCL check results to Dagster asset checks.

Installation

pip install dagster-soda

Note: dagster-soda requires soda-core 3.x (the soda.scan API). It pins soda-core>=3.0,<4 by default.

Usage

Component: SodaScanComponent

Configure a SodaScanComponent in your Dagster project to:

  • Point at SodaCL YAML check files and a Soda configuration.yml
  • Map Soda dataset names to Dagster asset keys
  • Run scans and report pass/fail as Dagster asset check results

Scaffolding with the CLI

Use the Dagster CLI to scaffold a new Soda scan component in your project (requires dagster-dg-cli):

dg scaffold defs dagster_soda.SodaScanComponent <path>

Example (scaffold into a folder named soda_checks under your defs directory):

dg scaffold defs dagster_soda.SodaScanComponent soda_checks

This generates:

  • A defs.yaml with default attributes (checks_paths, configuration_path, data_source_name, asset_key_map)
  • A checks.yml template with example SodaCL (e.g. checks for my_table: - row_count > 0)

Edit the generated files to match your data source and checks, then load your definitions as usual.

Minimal defs.yaml example

type: dagster_soda.SodaScanComponent
attributes:
  checks_paths:
    - checks.yml
  configuration_path: configuration.yml
  data_source_name: my_datasource
  asset_key_map:
    my_table: my_table

Documentation

The docs for dagster-soda can be found here.

Release files for dagster-soda 0.29.20

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-soda 0.29.20
File Size Uploaded
dagster_soda-0.29.20.tar.gz 201.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-soda 0.29.20
File Interpreter ABI Platform
dagster_soda-0.29.20-py3-none-any.whl Python 3 none any Details

Total release size: 213.7 kB

Release files / dagster_soda-0.29.20.tar.gz

Download URL dagster_soda-0.29.20.tar.gz
Size 201.5 kB
Tags Source
SHA-256 checksum
How to use checksums
275c4cd6e4aea1842f79ee885fc48f34cb2aac8b59ddb285388f9b3d5dc93c9c
BLAKE2b-256 checksum
How to use checksums
bf58fc00e93175cc30ce18e9f4cb5bc03fc77adfc279461dbd14747b560baa9e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14

Release files / dagster_soda-0.29.20-py3-none-any.whl

Download URL dagster_soda-0.29.20-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9ab98580b1cd0cee983002dd4090a5e8a9f3bfbb499a2d4a13baa3f2b7ea3f69
BLAKE2b-256 checksum
How to use checksums
6098cf1190276549a8d1e4af27301356d890707abc954331f0479365eb1a07cb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.14
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page