Skip to main content

Dagster automation driven by dbt metadata (Luban CI)

Project description

dbt-dagsterizer

dbt-dagsterizer is a Python package for building Dagster automation from dbt metadata.

It is designed to keep Dagster code locations mostly static, while letting developers declare orchestration intent in a small, reviewable YAML file alongside the dbt project.

Two common ways to use it

  1. As a CLI tool (bootstrap + maintain dagsterization.yml)
  • Install once:
uv tool install dbt-dagsterizer
  • Upgrade later:
uv tool upgrade dbt-dagsterizer

This is the recommended workflow for running dbt-dagsterizer project ..., dbt-dagsterizer meta ..., and dbt-dagsterizer macros ... from any repo.

  1. As a Python dependency (Dagster runtime imports it)

Dagster code locations typically import dbt_dagsterizer at runtime (for example build_definitions()), so the Dagster project itself must depend on dbt-dagsterizer (for example in its own pyproject.toml). Installing the CLI as a tool does not automatically make it importable inside that project’s runtime environment/container.

Documentation

Quick start

CLI

dbt-dagsterizer --help

Initialize orchestration intent and refresh the dbt manifest:

dbt-dagsterizer meta init --parse
dbt-dagsterizer meta validate --prepare

Python

from dbt_dagsterizer.api import build_definitions

defs = build_definitions(dbt_project_dir="./dbt_project")

If the project has no dbt models yet (no models/**/*.sql), build_definitions() still returns a minimal, always-loadable Definitions.

Development

This section is for developing dbt-dagsterizer itself. If you are using it in another repo, start with the CLI install instructions or add it as a dependency in your Dagster code location.

Setup:

uv sync --dev

Run tests:

uv run pytest

Lint:

uv run ruff check .

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_dagsterizer-0.1.13.tar.gz (146.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_dagsterizer-0.1.13-py3-none-any.whl (114.7 kB view details)

Uploaded Python 3

File details

Details for the file dbt_dagsterizer-0.1.13.tar.gz.

File metadata

  • Download URL: dbt_dagsterizer-0.1.13.tar.gz
  • Upload date:
  • Size: 146.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.14

File hashes

Hashes for dbt_dagsterizer-0.1.13.tar.gz
Algorithm Hash digest
SHA256 c7214695402a9c1a6c06d21bd21d95764f2eec52118cd6c554d8bc52881fa3ee
MD5 0823b7ed328d55549924e8331a43fe22
BLAKE2b-256 a06cd5ad3b808cad886fea2a628b15cce2579f3032c2058a17b1b303ea57e9c6

See more details on using hashes here.

File details

Details for the file dbt_dagsterizer-0.1.13-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_dagsterizer-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 2324dd29327558b4c249242a67ab6f46c5762869a3e4add14c211fd87d974aa1
MD5 483ee7226fa0716b366dc1d9ed7891df
BLAKE2b-256 9f16f38772ed8e9306a095e588000863e7dff71c4ef2fc183e22edcf80bc6749

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page