DataHub Prefect Plugin

Automatic lineage and run metadata from Prefect into DataHub — captures flow structure, task inputs/outputs, and run history with minimal setup.

What you can do

Emit flow and task metadata to DataHub as pipeline runs
Capture dataset lineage — declare inputs and outputs per task and see them in DataHub
Configure via Prefect blocks — store your DataHub connection settings as a reusable block
Works with any DataHub deployment — self-hosted or DataHub Cloud

Installation

pip install prefect-datahub

Quickstart

1. Save your DataHub connection as a Prefect block

from prefect_datahub.datahub_emitter import DatahubEmitter

DatahubEmitter(
    datahub_rest_url="http://localhost:8080",
    env="PROD",
).save("my-datahub")

2. Use it in your flows

from prefect import flow, task
from prefect_datahub.datahub_emitter import DatahubEmitter
from prefect_datahub.entities import Dataset

emitter = DatahubEmitter.load("my-datahub")

@task
def transform(data, emitter):
    emitter.add_task(
        inputs=[Dataset("snowflake", "mydb.schema.source_table")],
        outputs=[Dataset("snowflake", "mydb.schema.output_table")],
    )
    return data

@flow
def my_pipeline():
    data = extract()
    transform(data, emitter)
    emitter.emit_flow()   # required — emits all metadata at the end

Configuration options

Option	Default	Description
`datahub_rest_url`	`http://localhost:8080`	DataHub GMS URL
`env`	`PROD`	Environment tag for assets
`platform_instance`	`None`	Platform instance for assets
`token`	`None`	Auth token (if GMS auth is enabled)

Metadata

Release files for prefect-datahub 1.7.0.16rc1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for prefect-datahub 1.7.0.16rc1
File	Size	Uploaded	Provenance
prefect_datahub-1.7.0.16rc1.tar.gz	13.8 kB	Oct 21, 2026	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for prefect-datahub 1.7.0.16rc1
File	Interpreter	ABI	Platform	Reset
prefect_datahub-1.7.0.16rc1-py3-none-any.whl 11.9 kB Oct 21, 2026 Without provenance	Python 3	none	any	Details

Total release size: 25.7 kB

Release files / prefect_datahub-1.7.0.16rc1.tar.gz

Download URL	prefect_datahub-1.7.0.16rc1.tar.gz
Size	13.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`030ee09547b7ec44743c714830957b546ce7409e4eb42b684cfadfa6b401ccd7`
BLAKE2b-256 checksum How to use checksums	`e23ced96caa8803c3a248e785dd77bc7474df8d168616d63db0280c144662c4e`
Upload date	Oct 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.10.22`

Release files / prefect_datahub-1.7.0.16rc1-py3-none-any.whl

Download URL	prefect_datahub-1.7.0.16rc1-py3-none-any.whl
Size	11.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`90a403c615422af199b62bc3b4ad3eb30287dc76ee39c8f27ef060d44f621a60`
BLAKE2b-256 checksum How to use checksums	`b718b49018968e008db074189330f7fb5193b540677cda270b8a237f230c8fa1`
Upload date	Oct 21, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.10.22`

Security for prefect-datahub 1.7.0.16rc1

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.