dagster-rocky
Dagster integration for Rocky, the typed graph between your code and your warehouse.
dagster-rocky wraps the rocky CLI as a Dagster ConfigurableResource and exposes Rocky-managed
tables as materializable Dagster assets. Compile-time contracts, column-level lineage, schema-drift
detection, quality check results, and per-model cost surface as native Dagster events, so the
guarantees Rocky enforces at compile time appear directly in the Dagster asset graph.
Install
uv add dagster-rocky
You'll also need the Rocky CLI on your $PATH:
https://github.com/rocky-data/rocky/releases?q=engine
Quick start (component)
Add a defs.yaml next to your other Dagster definitions:
type: dagster_rocky.RockyComponent
attributes:
binary_path: rocky
config_path: config/rocky.toml
models_dir: models
Dagster's component loader will:
- Run
rocky discover(androcky compile, when models are present) and cache the result. - Build one subset-aware
multi_assetper Rocky group, with declaredrow_count/column_match/freshnesschecks per table. - On materialization, shell out to
rocky run --filter <key>=<value>for the selected subset and yieldMaterializeResult+AssetCheckResultevents with rich metadata.
Quick start (resource)
import dagster as dg
from dagster_rocky import RockyResource
rocky = RockyResource(
binary_path="rocky",
config_path="config/rocky.toml",
timeout_seconds=3600,
)
defs = dg.Definitions(resources={"rocky": rocky})
Then in an asset:
@dg.asset
def acme_orders(rocky: RockyResource) -> dg.MaterializeResult:
result = rocky.run(filter="tenant=acme")
return dg.MaterializeResult(
metadata={"tables_copied": result.tables_copied, "duration_ms": result.duration_ms},
)
Public API
| Symbol | Purpose |
|---|---|
RockyResource |
ConfigurableResource wrapping the Rocky CLI |
RockyComponent |
State-backed Dagster component that loads Rocky tables as assets |
RockyDagsterTranslator |
Subclass to customize asset key / group / tag mapping |
RockyMetadataSet |
Namespaced metadata (source_id, strategy, watermark, …) |
load_rocky_assets() |
Functional helper that returns AssetSpec for each Rocky table |
emit_materializations() / emit_check_results() |
Convert a RunResult into Dagster events |
check_metadata() |
Build a metadata mapping for a single Rocky CheckResult |
cost_metadata_from_optimize() |
Extract per-model cost recommendations from OptimizeResult |
parse_rocky_output() |
Auto-detect a Rocky JSON payload and return the matching Pydantic model |
Documentation
- Dagster Integration docs: resource, component, translator, schedules, sensors, pipes, and more
- DEVELOPMENT.md: local setup, architecture, testing
- CHANGELOG.md: release notes
Related projects
- Rocky: the Rust SQL transformation engine
- Rocky VS Code extension: VS Code extension with LSP and AI features
License
Apache 2.0
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dagster_rocky-1.58.0.tar.gz.
File metadata
- Download URL: dagster_rocky-1.58.0.tar.gz
- Upload date:
- Size: 359.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8ce013e815d938f3f423b11e093dd99b59795dbaa324e3fc978e79d6699cbb2e
|
|
| MD5 |
72e919e7c5dab2a22d9230283e6964df
|
|
| BLAKE2b-256 |
74e354e60e572ef85d3324a75e5ff83c2e78eb4aef2affd8207e2db909194920
|
Provenance
The following attestation bundles were made for dagster_rocky-1.58.0.tar.gz:
Publisher:
dagster-release.yml on rocky-data/rocky
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
dagster_rocky-1.58.0.tar.gz -
Subject digest:
8ce013e815d938f3f423b11e093dd99b59795dbaa324e3fc978e79d6699cbb2e - Sigstore transparency entry: 2134195645
- Sigstore integration time:
-
Permalink:
rocky-data/rocky@0f2c140db1c0aed57a831c864c170f1b2559387e -
Branch / Tag:
refs/tags/dagster-v1.58.0 - Owner: https://github.com/rocky-data
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
dagster-release.yml@0f2c140db1c0aed57a831c864c170f1b2559387e -
Trigger Event:
push
-
Statement type:
File details
Details for the file dagster_rocky-1.58.0-py3-none-any.whl.
File metadata
- Download URL: dagster_rocky-1.58.0-py3-none-any.whl
- Upload date:
- Size: 122.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6e61943b9215154c531b6c16907cd25018278ddffbf0deba8e2c4eeea7d85c2d
|
|
| MD5 |
9a36b093430e42486d025cce11316e03
|
|
| BLAKE2b-256 |
223bbc8d42e7d3fd9a381c6aa64c54c8778f564c471c25c5adbba0d9e804911c
|
Provenance
The following attestation bundles were made for dagster_rocky-1.58.0-py3-none-any.whl:
Publisher:
dagster-release.yml on rocky-data/rocky
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
dagster_rocky-1.58.0-py3-none-any.whl -
Subject digest:
6e61943b9215154c531b6c16907cd25018278ddffbf0deba8e2c4eeea7d85c2d - Sigstore transparency entry: 2134195707
- Sigstore integration time:
-
Permalink:
rocky-data/rocky@0f2c140db1c0aed57a831c864c170f1b2559387e -
Branch / Tag:
refs/tags/dagster-v1.58.0 - Owner: https://github.com/rocky-data
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
dagster-release.yml@0f2c140db1c0aed57a831c864c170f1b2559387e -
Trigger Event:
push
-
Statement type:
