Event-driven action framework for DataHub — trigger automations and workflows in response to real-time metadata changes
Project description
DataHub Actions
Event-driven automation for DataHub — react to metadata changes in real time and trigger workflows, notifications, or custom logic.
What you can do
- Listen to metadata change events as they happen (entity updates, tag additions, ownership changes, etc.)
- Filter events to only act on what matters to you
- Chain transformers to enrich or reshape events before they reach your action
- Build custom actions — call APIs, send Slack alerts, trigger pipelines, sync to external systems
- Run multiple pipelines in a single process
Installation
pip install acryl-datahub acryl-datahub-actions
datahub actions version
Quickstart
Define an action pipeline in YAML and run it:
# my_action.yml
name: tag_watcher
source:
type: kafka
config:
connection:
bootstrap: localhost:9092
schema_registry_url: http://localhost:8081
filter:
event_type: EntityChangeEvent_v1
event:
category: TAG
operation: ADD
action:
type: hello_world
datahub actions -c my_action.yml
Key concepts
| Concept | Description |
|---|---|
| Source | Where events come from (currently: Kafka) |
| Filter | Narrow down which events trigger the action |
| Transformer | Optionally reshape or enrich events |
| Action | What to do — call an API, send a message, run code |
Supported events
EntityChangeEvent_v1— fired when an entity's metadata changes (tags, owners, terms, etc.)MetadataChangeLogEvent_v1— low-level log of every aspect write
Links
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file acryl_datahub_actions-1.6.0.11rc2.tar.gz.
File metadata
- Download URL: acryl_datahub_actions-1.6.0.11rc2.tar.gz
- Upload date:
- Size: 77.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.20
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5789dde81fcee53327e77b55f39ebccf05599b464f3accf90606f2ab20966839
|
|
| MD5 |
ddfb9d290ecea82426384026808938cf
|
|
| BLAKE2b-256 |
14980bb39f86304b1fac6d655eba720fefb0b9503919a75e80bc53246555d29a
|
File details
Details for the file acryl_datahub_actions-1.6.0.11rc2-py3-none-any.whl.
File metadata
- Download URL: acryl_datahub_actions-1.6.0.11rc2-py3-none-any.whl
- Upload date:
- Size: 122.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.20
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
de1839c7c92c08a959a1989d89bb4e3d0ac3f50facaa05b32400d615bfce836a
|
|
| MD5 |
cc3373b08d02b690c2a9ec107068e7c8
|
|
| BLAKE2b-256 |
3002cc4f36c3727249f1c2470ea813719eccc3062cefe011665d5ffee7ba66d9
|