OpenLineage integration with dbt
OpenLineage dbt integration
Wrapper script for automatic metadata collection from dbt
- Model run lifecycle
- Model inputs / outputs
openlineage-dbt only supports
redshift dbt adapters.
$ pip3 install openlineage-dbt
To install from source, run:
$ pip install .
HTTP Backend Environment Variables
openlineage-dbt uses the OpenLineage client to push data to the OpenLineage backend.
The OpenLineage client depends on environment variables:
OPENLINEAGE_URL- point to service which will consume OpenLineage events
OPENLINEAGE_API_KEY- set if consumer of OpenLineage events requires
OPENLINEAGE_NAMESPACE- set if you are using something other than the
defaultnamespace for job namespace.
In addition to conventional logging approaches, the OpenLineage dbt wrapper script provides an alternative way of configuring its logging behavior. By setting the
OPENLINEAGE_DBT_LOGGING environment variable, you can establish the logging level for the
openlineage.dbt and its child modules.
You can also set log level of
dbtol which is deprecated.
To begin collecting dbt metadata with OpenLineage, replace
dbt run with
Additional table and column level metadata will be available if
catalog.json, a result of running
dbt docs generate, will be found in the target directory.
Copyright 2018-2023 contributors to the OpenLineage project
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Hashes for openlineage_dbt-1.2.2-py3-none-any.whl