Dagster automation driven by dbt metadata (Luban CI)
Project description
dbt-dagsterizer
dbt-dagsterizer is a Python package for building Dagster automation from dbt metadata.
It is designed to keep Dagster code locations mostly static, while letting developers declare orchestration intent in a small, reviewable YAML file alongside the dbt project.
Two common ways to use it
- As a CLI tool (bootstrap + maintain
dagsterization.yml)
- Install once:
uv tool install dbt-dagsterizer
- Upgrade later:
uv tool upgrade dbt-dagsterizer
This is the recommended workflow for running dbt-dagsterizer project ..., dbt-dagsterizer meta ..., and dbt-dagsterizer macros ... from any repo.
- As a Python dependency (Dagster runtime imports it)
Dagster code locations typically import dbt_dagsterizer at runtime (for example build_definitions()), so the Dagster project itself must depend on dbt-dagsterizer (for example in its own pyproject.toml). Installing the CLI as a tool does not automatically make it importable inside that project’s runtime environment/container.
Documentation
- Docs index: docs/README.md
- Getting started: docs/getting-started.md
- CLI reference: docs/concepts/cli.md
- Template docs (Dagster + dbt + StarRocks): docs/templates/.../README.md
Quick start
CLI
dbt-dagsterizer --help
Initialize orchestration intent and refresh the dbt manifest:
dbt-dagsterizer meta init --parse
dbt-dagsterizer meta validate --prepare
Python
from dbt_dagsterizer.api import build_definitions
defs = build_definitions(dbt_project_dir="./dbt_project")
If the project has no dbt models yet (no models/**/*.sql), build_definitions() still returns a minimal, always-loadable Definitions.
Development
This section is for developing dbt-dagsterizer itself. If you are using it in another repo, start with the CLI install instructions or add it as a dependency in your Dagster code location.
Setup:
uv sync --dev
Run tests:
uv run pytest
Lint:
uv run ruff check .
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dbt_dagsterizer-0.1.13.tar.gz.
File metadata
- Download URL: dbt_dagsterizer-0.1.13.tar.gz
- Upload date:
- Size: 146.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c7214695402a9c1a6c06d21bd21d95764f2eec52118cd6c554d8bc52881fa3ee
|
|
| MD5 |
0823b7ed328d55549924e8331a43fe22
|
|
| BLAKE2b-256 |
a06cd5ad3b808cad886fea2a628b15cce2579f3032c2058a17b1b303ea57e9c6
|
File details
Details for the file dbt_dagsterizer-0.1.13-py3-none-any.whl.
File metadata
- Download URL: dbt_dagsterizer-0.1.13-py3-none-any.whl
- Upload date:
- Size: 114.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2324dd29327558b4c249242a67ab6f46c5762869a3e4add14c211fd87d974aa1
|
|
| MD5 |
483ee7226fa0716b366dc1d9ed7891df
|
|
| BLAKE2b-256 |
9f16f38772ed8e9306a095e588000863e7dff71c4ef2fc183e22edcf80bc6749
|