`dagster-ext` is a Meltano utility extension.
Project description
Meltano Dagster Extention
This project uses dagster-meltano
under the hood.
Features
- Load all Meltano jobs as Dagster jobs.
- Add all correspondig schedules to these jobs.
- (todo) Load all DBT models as Dagster assets.
- (todo) Load all Singer tap streams as Dagster assets.
- (todo) Ops to perform all Meltano actions.
- (todo) Extract Singer metrics from logs and store them using Dagster.
Installation
# Add the dagster-ext to your Meltano project
meltano add utility dagster
# Initialize your Dagster project
meltano invoke dagster:initialize
# Start Dagit
meltano invoke dagster:start
Commands
meltano invoke dagster:initialize
Setup a new Dagster project and automatically load jobs and assets from your Meltano project.
meltano invoke dagster:start
Start Dagit to serve your local Dagster deployment.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dagster_ext-0.1.2.tar.gz
(10.3 kB
view details)
Built Distribution
File details
Details for the file dagster_ext-0.1.2.tar.gz
.
File metadata
- Download URL: dagster_ext-0.1.2.tar.gz
- Upload date:
- Size: 10.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 34524de01fc3cd013f15bf7a4c414b282a2fa95dd30395579fbd2583dd486dcb |
|
MD5 | 3f7f8f26d2e8d0f18ebe3208ade6acd1 |
|
BLAKE2b-256 | fc20ae5d075e52e7d64c750c5611dff11716de1c71e8ec0ea2e45a70c69b0e3d |
File details
Details for the file dagster_ext-0.1.2-py3-none-any.whl
.
File metadata
- Download URL: dagster_ext-0.1.2-py3-none-any.whl
- Upload date:
- Size: 13.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 10ecbab1d1a63364256f1487fa5990273f51a3aa0376399520c841fb7c39b057 |
|
MD5 | bb3803f16a55334adcf68ec02268ef55 |
|
BLAKE2b-256 | 0b068bda5a8fbd0055cfa997010185e9b830657a67a9a0f7dab87b020f025a54 |