DataHub Prefect Plugin

Automatic lineage and run metadata from Prefect into DataHub — captures flow structure, task inputs/outputs, and run history with minimal setup.

What you can do

Emit flow and task metadata to DataHub as pipeline runs
Capture dataset lineage — declare inputs and outputs per task and see them in DataHub
Configure via Prefect blocks — store your DataHub connection settings as a reusable block
Works with any DataHub deployment — self-hosted or DataHub Cloud

Installation

pip install prefect-datahub

Quickstart

1. Save your DataHub connection as a Prefect block

from prefect_datahub.datahub_emitter import DatahubEmitter

DatahubEmitter(
    datahub_rest_url="http://localhost:8080",
    env="PROD",
).save("my-datahub")

2. Use it in your flows

from prefect import flow, task
from prefect_datahub.datahub_emitter import DatahubEmitter
from prefect_datahub.entities import Dataset

emitter = DatahubEmitter.load("my-datahub")

@task
def transform(data, emitter):
    emitter.add_task(
        inputs=[Dataset("snowflake", "mydb.schema.source_table")],
        outputs=[Dataset("snowflake", "mydb.schema.output_table")],
    )
    return data

@flow
def my_pipeline():
    data = extract()
    transform(data, emitter)
    emitter.emit_flow()   # required — emits all metadata at the end

Configuration options

Option	Default	Description
`datahub_rest_url`	`http://localhost:8080`	DataHub GMS URL
`env`	`PROD`	Environment tag for assets
`platform_instance`	`None`	Platform instance for assets
`token`	`None`	Auth token (if GMS auth is enabled)

Metadata

Release files for prefect-datahub 1.7.0.15rc6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for prefect-datahub 1.7.0.15rc6
File	Size	Uploaded	Provenance
prefect_datahub-1.7.0.15rc6.tar.gz	13.8 kB	Oct 21, 2026	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for prefect-datahub 1.7.0.15rc6
File	Interpreter	ABI	Platform	Reset
prefect_datahub-1.7.0.15rc6-py3-none-any.whl 11.9 kB Oct 21, 2026 Without provenance	Python 3	none	any	Details

Total release size: 25.7 kB

Release files / prefect_datahub-1.7.0.15rc6.tar.gz

Download URL	prefect_datahub-1.7.0.15rc6.tar.gz
Size	13.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`961f281e01bb3030902fe27d9c8a48f3e392ba38e23605d1018279e54b3652ee`
BLAKE2b-256 checksum How to use checksums	`3086d48a781472726d1a6e474a6c1277cdccda156c0d7a08fb7860ed3e4188aa`
Upload date	Oct 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.10.22`

Release files / prefect_datahub-1.7.0.15rc6-py3-none-any.whl

Download URL	prefect_datahub-1.7.0.15rc6-py3-none-any.whl
Size	11.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`8ff15c9debcd4f55bfd2e764eca3c94cd38dfb67ec6d5c17e60cbd6ddc541d28`
BLAKE2b-256 checksum How to use checksums	`598a1bc6d065c03b0c3e2c191666041b95e710c2da071ab4eb8a9b108a007c2d`
Upload date	Oct 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.10.22`

Security for prefect-datahub 1.7.0.15rc6

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.