Skip to main content

Dagster automation driven by dbt metadata (Luban CI)

Project description

dbt-dagsterizer

dbt-dagsterizer is a Python package for building Dagster automation from dbt metadata.

It is designed to keep Dagster code locations mostly static, while letting developers declare orchestration intent in a small, reviewable YAML file alongside the dbt project.

Two common ways to use it

  1. As a CLI tool (bootstrap + maintain dagsterization.yml)
  • Install once:
uv tool install dbt-dagsterizer
  • Upgrade later:
uv tool upgrade dbt-dagsterizer

This is the recommended workflow for running dbt-dagsterizer project ..., dbt-dagsterizer meta ..., and dbt-dagsterizer macros ... from any repo.

  1. As a Python dependency (Dagster runtime imports it)

Dagster code locations typically import dbt_dagsterizer at runtime (for example build_definitions()), so the Dagster project itself must depend on dbt-dagsterizer (for example in its own pyproject.toml). Installing the CLI as a tool does not automatically make it importable inside that project’s runtime environment/container.

Documentation

Quick start

CLI

dbt-dagsterizer --help

Initialize orchestration intent and refresh the dbt manifest:

dbt-dagsterizer meta init --parse
dbt-dagsterizer meta validate --prepare

Python

from dbt_dagsterizer.api import build_definitions

defs = build_definitions(dbt_project_dir="./dbt_project")

If the project has no dbt models yet (no models/**/*.sql), build_definitions() still returns a minimal, always-loadable Definitions.

Development

This section is for developing dbt-dagsterizer itself. If you are using it in another repo, start with the CLI install instructions or add it as a dependency in your Dagster code location.

Setup:

uv sync --dev

Run tests:

uv run pytest

Lint:

uv run ruff check .

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_dagsterizer-0.1.12.tar.gz (146.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbt_dagsterizer-0.1.12-py3-none-any.whl (109.5 kB view details)

Uploaded Python 3

File details

Details for the file dbt_dagsterizer-0.1.12.tar.gz.

File metadata

  • Download URL: dbt_dagsterizer-0.1.12.tar.gz
  • Upload date:
  • Size: 146.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.14

File hashes

Hashes for dbt_dagsterizer-0.1.12.tar.gz
Algorithm Hash digest
SHA256 fb28fc04352c535ccbc29469290bdb49097b89f311576bf92affdd4b7311a69f
MD5 1029e0deaecd100eb5a4ae9f34ca7a24
BLAKE2b-256 05827d9917434b0d6575e36cee3ba2a6ebc9bcd6128ac8cae4f2cee0b3a21201

See more details on using hashes here.

File details

Details for the file dbt_dagsterizer-0.1.12-py3-none-any.whl.

File metadata

File hashes

Hashes for dbt_dagsterizer-0.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 5c6c0a30885db436d80441da1db97138c8d09cac7f0b8cfc9fc048e2271fccdc
MD5 8d1ff3f5e293671da70c58116d2a8d49
BLAKE2b-256 2e833ef80a9cf495a8a2dfdf2ec411a050be16c49f5cb365227c8f9084f4eaa5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page