Skip to main content

Event-driven action framework for DataHub — trigger automations and workflows in response to real-time metadata changes

Project description

DataHub Actions

Event-driven automation for DataHub — react to metadata changes in real time and trigger workflows, notifications, or custom logic.

What you can do

  • Listen to metadata change events as they happen (entity updates, tag additions, ownership changes, etc.)
  • Filter events to only act on what matters to you
  • Chain transformers to enrich or reshape events before they reach your action
  • Build custom actions — call APIs, send Slack alerts, trigger pipelines, sync to external systems
  • Run multiple pipelines in a single process

Installation

pip install acryl-datahub acryl-datahub-actions
datahub actions version

Quickstart

Define an action pipeline in YAML and run it:

# my_action.yml
name: tag_watcher

source:
  type: kafka
  config:
    connection:
      bootstrap: localhost:9092
      schema_registry_url: http://localhost:8081

filter:
  event_type: EntityChangeEvent_v1
  event:
    category: TAG
    operation: ADD

action:
  type: hello_world
datahub actions -c my_action.yml

Key concepts

Concept Description
Source Where events come from (currently: Kafka)
Filter Narrow down which events trigger the action
Transformer Optionally reshape or enrich events
Action What to do — call an API, send a message, run code

Supported events

  • EntityChangeEvent_v1 — fired when an entity's metadata changes (tags, owners, terms, etc.)
  • MetadataChangeLogEvent_v1 — low-level log of every aspect write

Links

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

acryl_datahub_actions-1.6.0.13.tar.gz (77.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

acryl_datahub_actions-1.6.0.13-py3-none-any.whl (122.3 kB view details)

Uploaded Python 3

File details

Details for the file acryl_datahub_actions-1.6.0.13.tar.gz.

File metadata

  • Download URL: acryl_datahub_actions-1.6.0.13.tar.gz
  • Upload date:
  • Size: 77.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for acryl_datahub_actions-1.6.0.13.tar.gz
Algorithm Hash digest
SHA256 cd60d865d731b8c84269be8d9a4a9a9b19e91c57ac55266e11cd7fe845661373
MD5 13dc751c8a77b2e97e8b0252ab9be60d
BLAKE2b-256 d3cf503ebe6d156a0de6cece4f5f72e835c978bb0319dca9cb1f455b991b4712

See more details on using hashes here.

File details

Details for the file acryl_datahub_actions-1.6.0.13-py3-none-any.whl.

File metadata

File hashes

Hashes for acryl_datahub_actions-1.6.0.13-py3-none-any.whl
Algorithm Hash digest
SHA256 4b0bd0da6dc3a43f726228024adabcdb05b05b77eeadfc233c7a84123a9bb1c1
MD5 9e28dab0e23cc949f538655f78cb7683
BLAKE2b-256 9ee7f90f5ac8dc5a6bf4cc2d70fb8282bf51fde64791690c308e468e8bb9d2d4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page