Skip to main content

DataHub Great Expectations (GX) Plugin

Send Great Expectations data quality results into DataHub — surface assertion outcomes alongside your dataset metadata so teams can see data health at a glance.

What you can do

  • Emit assertion results from GX Checkpoints directly into DataHub as data quality assertions
  • Link quality checks to datasets — results appear on the dataset's profile in DataHub
  • Track pass/fail history over time for every expectation suite
  • Works with any DataHub deployment — self-hosted or DataHub Cloud

Compatibility

GX version Module
0.17.x / 0.18.x datahub_gx_plugin.action.DataHubValidationAction
1.x datahub_gx_plugin.action_v1.DataHubValidationAction

Both APIs are supported additively in the same package. Use the module that matches your installed GX major version.

Installation

pip install acryl-datahub-gx-plugin

Quickstart (GX 0.17 / 0.18)

Add the DataHub action to your GX Checkpoint:

from datahub_gx_plugin.action import DataHubValidationAction
from great_expectations.checkpoint import Checkpoint

checkpoint = Checkpoint(
    name="my_checkpoint",
    data_context=context,
    action_list=[
        {
            "name": "datahub",
            "action": {
                "class_name": "DataHubValidationAction",
                "module_name": "datahub_gx_plugin.action",
                "server_url": "http://localhost:8080",
            },
        }
    ],
)

Quickstart (GX Core 1.x)

import great_expectations as gx
from datahub_gx_plugin.action_v1 import DataHubValidationAction

context = gx.get_context()
# ... create validation_definitions ...

checkpoint = context.checkpoints.add(
    gx.Checkpoint(
        name="my_checkpoint",
        validation_definitions=validation_definitions,
        actions=[
            DataHubValidationAction(
                name="datahub",
                server_url="http://localhost:8080",
                # Optional when batch_spec meta is incomplete:
                # platform="postgres",
                # dataset_name="public.my_table",
            )
        ],
    )
)
checkpoint.run()

Results from every Checkpoint run will appear in DataHub under the dataset's Validation tab.

Links

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

acryl_datahub_gx_plugin-1.7.0.tar.gz (20.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

acryl_datahub_gx_plugin-1.7.0-py3-none-any.whl (20.5 kB view details)

Uploaded Python 3

File details

Details for the file acryl_datahub_gx_plugin-1.7.0.tar.gz.

File metadata

  • Download URL: acryl_datahub_gx_plugin-1.7.0.tar.gz
  • Upload date:
  • Size: 20.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.10.20

File hashes

Hashes for acryl_datahub_gx_plugin-1.7.0.tar.gz
Algorithm Hash digest
SHA256 e3dfd601664dbc06a5793bc8ab38e4f4cf34b2e8fab4714a237b5dabfcf35669
MD5 e5d146feb36e5ba56ff5789eacb21dc7
BLAKE2b-256 97daecb577357a6d65b736dea83af8deba75d7acb1116d66ae7f22ee7ea31c6b

See more details on using hashes here.

File details

Details for the file acryl_datahub_gx_plugin-1.7.0-py3-none-any.whl.

File metadata

File hashes

Hashes for acryl_datahub_gx_plugin-1.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 72b8db2fdb9efe1bbac0da9cd0fd16deb9bc007cd5927cbab14f519e44f2256a
MD5 f231fa96c900136afd33c6b80b493035
BLAKE2b-256 5dc2a8fee4943385e6ce9c45ed937134c82360dc4ac60e2fefb9539c021817ad

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

1.7.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page