dagster-meltano 0.0.2

A Dagster plugin that allows you to run Meltano in Dagster

Dagster-meltano (Under development)

A dagster plugin that allows you to run Meltano pipelines using Dagster.

Installation

1. Install using pip pip install dagster-meltano.
2. Make sure you have an installed Meltano project.
3. Point the plugin to the root of the Meltano project by defining MELTANO_PROJECT_ROOT.

Example

An example of a Dagster pipeline that runs a Meltano elt process.

from dagster import pipeline
from dagster_meltano.solids import meltano_elt_solid

@pipeline
def meltano_pipeline():
    meltano_elt_solid(
        tap='tap-csv',
        target='target-jsonl',
        job_id='csv-to-jsonl' #Optional
    )

Development

1. Open this repository in Visual Studio Code.
2. Install the Remote - Containers plugin for Visual Studio Code.
3. Wait for the container setup, it should automatically install all Meltano plugins and start Dagit.
4. Visit localhost:3000 to access Dagit.