Skip to main content

Meltano Dagster Extention

PyPI version

This project uses dagster-meltano under the hood.

Features

  • Load all Meltano jobs as Dagster jobs.
  • Add all correspondig schedules to these jobs.
  • (todo) Load all DBT models as Dagster assets.
  • (todo) Load all Singer tap streams as Dagster assets.
  • (todo) Ops to perform all Meltano actions.
  • (todo) Extract Singer metrics from logs and store them using Dagster.

Installation

# Add the dagster-ext to your Meltano project
meltano add utility dagster

# Initialize your Dagster project
meltano invoke dagster:initialize

# Start Dagit
meltano invoke dagster:start

Commands

meltano invoke dagster:initialize

Setup a new Dagster project and automatically load jobs and assets from your Meltano project.

meltano invoke dagster:start

Start Dagit to serve your local Dagster deployment.

Release files for dagster-ext 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagster-ext 0.1.3
File Size Uploaded
dagster_ext-0.1.3.tar.gz 10.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dagster-ext 0.1.3
File Interpreter ABI Platform
dagster_ext-0.1.3-py3-none-any.whl Python 3 none any Details

Total release size: 23.9 kB

Release files / dagster_ext-0.1.3.tar.gz

Download URL dagster_ext-0.1.3.tar.gz
Size 10.0 kB
Tags Source
SHA-256 checksum
How to use checksums
dca46ba77eadeb156cdff693f55efe6f99a646be111874f6ecf3e0b43f4715b9
BLAKE2b-256 checksum
How to use checksums
ee2f47acb82388a6a21082936461398eeb765979ec7e40acfe8c6f0cdffd3eb8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.0.0 CPython/3.12.3 Linux/6.8.0-1017-azure

Release files / dagster_ext-0.1.3-py3-none-any.whl

Download URL dagster_ext-0.1.3-py3-none-any.whl
Size 13.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
abdfafe7facfb634cc8bd27912c39909294bc7129767b05c3833c2fadfc69f27
BLAKE2b-256 checksum
How to use checksums
b3d8d4ff95205ce9b317aec9058bf5c8e39547cbfde733d04b309ac0cad026d3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.0.0 CPython/3.12.3 Linux/6.8.0-1017-azure
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page