This release is a pre-release and may not be stable for production use.
DataHub Dagster Plugin
Automatic lineage and run metadata from Dagster into DataHub — captures asset definitions, job runs, and dataset-level lineage with no manual instrumentation.
What you can do
- Capture asset lineage — automatically extract upstream/downstream relationships between Dagster assets and external datasets
- Track run history — record job execution status and task-level outcomes in DataHub
- Map Dagster assets to DataHub entities — assets appear as datasets in your DataHub catalog
- Works with any DataHub deployment — self-hosted or DataHub Cloud
Installation
pip install acryl-datahub-dagster-plugin
Quickstart
Add the DataHub sensor to your Dagster project:
from datahub.ingestion.graph.config import DatahubClientConfig
from datahub_dagster_plugin.sensors.datahub_sensors import (
DatahubDagsterSourceConfig,
make_datahub_sensor,
)
config = DatahubDagsterSourceConfig(
datahub_client_config=DatahubClientConfig(server="http://localhost:8080"),
dagster_url="http://localhost:3000",
)
datahub_sensor = make_datahub_sensor(config=config)
Register it alongside your jobs and assets in your Definitions:
from dagster import Definitions
defs = Definitions(
assets=[...],
jobs=[...],
sensors=[datahub_sensor],
)
Once the sensor is running, every job run will emit lineage and status metadata to DataHub automatically.
Links
1 maintainer
Metadata
1 maintainer
Release files for acryl-datahub-dagster-plugin 1.7.0.15rc5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| acryl_datahub_dagster_plugin-1.7.0.15rc5.tar.gz | 21.2 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| acryl_datahub_dagster_plugin-1.7.0.15rc5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 42.9 kB
Release files / acryl_datahub_dagster_plugin-1.7.0.15rc5.tar.gz
| Download URL | acryl_datahub_dagster_plugin-1.7.0.15rc5.tar.gz |
|---|---|
| Size | 21.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9b6bfc02f10924338e9790c900227652a6b01ce0846b1a1c643910fbc6d40a32
|
|
BLAKE2b-256 checksum How to use checksums |
ea909b00cc6630a483e0b5512ce738459a832a8bac7bd802d61011ad4497ea60
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.22
|
Release files / acryl_datahub_dagster_plugin-1.7.0.15rc5-py3-none-any.whl
| Download URL | acryl_datahub_dagster_plugin-1.7.0.15rc5-py3-none-any.whl |
|---|---|
| Size | 21.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
65bc266748ef431c088bfcd84ebb9d349b2d387c20e53347fb92165e1a395e5b
|
|
BLAKE2b-256 checksum How to use checksums |
c7b50ca8d6e9ed44abee37b97d78bb21c2db559318a707cec6cf5abb6bc2518a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.22
|
Security for acryl-datahub-dagster-plugin 1.7.0.15rc5
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
