Skip to main content

Dagster automation driven by dbt metadata (Luban CI)

Project description

dbt-dagsterizer

dbt-dagsterizer is a Python package for building Dagster automation from dbt metadata.

It is designed to keep Dagster code locations mostly static, while letting developers declare orchestration intent in a small, reviewable YAML file alongside the dbt project.

Two common ways to use it

  1. As a CLI tool (bootstrap + maintain dagsterization.yml)
  • Install once:
uv tool install dbt-dagsterizer
  • Upgrade later:
uv tool upgrade dbt-dagsterizer

This is the recommended workflow for running dbt-dagsterizer project ..., dbt-dagsterizer meta ..., and dbt-dagsterizer macros ... from any repo.

  1. As a Python dependency (Dagster runtime imports it)

Dagster code locations typically import dbt_dagsterizer at runtime (for example build_definitions()), so the Dagster project itself must depend on dbt-dagsterizer (for example in its own pyproject.toml). Installing the CLI as a tool does not automatically make it importable inside that project’s runtime environment/container.

Documentation

Quick start

CLI

dbt-dagsterizer --help

Initialize orchestration intent and refresh the dbt manifest:

dbt-dagsterizer meta init --parse
dbt-dagsterizer meta validate --prepare

Python

from dbt_dagsterizer.api import build_definitions

defs = build_definitions(dbt_project_dir="./dbt_project")

If the project has no dbt models yet (no models/**/*.sql), build_definitions() still returns a minimal, always-loadable Definitions.

Development

This section is for developing dbt-dagsterizer itself. If you are using it in another repo, start with the CLI install instructions or add it as a dependency in your Dagster code location.

Setup:

uv sync --dev

Run tests:

uv run pytest

Lint:

uv run ruff check .

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_dagsterizer-0.1.10.tar.gz (144.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_dagsterizer-0.1.10-py3-none-any.whl (109.3 kB view details)

Uploaded Python 3

File details

Details for the file dbt_dagsterizer-0.1.10.tar.gz.

File metadata

  • Download URL: dbt_dagsterizer-0.1.10.tar.gz
  • Upload date:
  • Size: 144.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.14

File hashes

Hashes for dbt_dagsterizer-0.1.10.tar.gz
Algorithm Hash digest
SHA256 4a04494e8f2bbc8bb25640fa44ae585f63a443cef47e99eedf69842bee1d8e16
MD5 58d9fc2cf2d8490d14266555efcd9d56
BLAKE2b-256 a3e27df005c1c3c0fa6f96ced1e3e53f8dbe89dbc3f00c899be320f8aa73ca00

See more details on using hashes here.

File details

Details for the file dbt_dagsterizer-0.1.10-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_dagsterizer-0.1.10-py3-none-any.whl
Algorithm Hash digest
SHA256 95d76abad7ee23419359cd3ec8174ace49b939d75808d05702b2056396276e88
MD5 ed8a2e07113804310a8d79cd13c31a16
BLAKE2b-256 5fc38a0e11cb8c94ad5384baa3fa60ecd87390f0161b506a48aa5343fdf660f9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page