`dagster-ext` is a Meltano utility extension.
Project description
Meltano Dagster Extention
This project uses dagster-meltano
under the hood.
Features
- Load all Meltano jobs as Dagster jobs.
- Add all correspondig schedules to these jobs.
- (todo) Load all DBT models as Dagster assets.
- (todo) Load all Singer tap streams as Dagster assets.
- (todo) Ops to perform all Meltano actions.
- (todo) Extract Singer metrics from logs and store them using Dagster.
Installation
# Add the dagster-ext to your Meltano project
meltano add utility dagster
# Initialize your Dagster project
meltano invoke dagster:initialize
# Start Dagit
meltano invoke dagster:start
Commands
meltano invoke dagster:initialize
Setup a new Dagster project and automatically load jobs and assets from your Meltano project.
meltano invoke dagster:start
Start Dagit to serve your local Dagster deployment.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dagster_ext-0.1.1.tar.gz
(10.3 kB
view hashes)
Built Distribution
Close
Hashes for dagster_ext-0.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fcb909c8e21c790666a89bde999275226c16e74e1699a8c7b9d5ba11e21b5d7a |
|
MD5 | 32dacaf3ea028c5deaacefa18ec3a488 |
|
BLAKE2b-256 | ee626cac1c03e690cc43d4210ef1466cd8b1d2ec5f6e116a8c5953f537cdfa3d |