Ingestion Framework for OpenMetadata
Project description
— This guide will help you setup the Ingestion framework and connectors —
![Python version 3.8+](https://img.shields.io/badge/python-3.8%2B-blue)
OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites
Python >= 3.8.x
### Docs
Please refer to the documentation here https://docs.open-metadata.org/connectors
<img referrerpolicy=”no-referrer-when-downgrade” src=”https://static.scarf.sh/a.png?x-pxid=c1a30c7c-6dc7-4928-95bf-6ee08ca6aa6a” />
### TopologyRunner
All the Ingestion Workflows run through the TopologyRunner.
The flow is depicted in the images below.
TopologyRunner Standard Flow
![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/single-thread-flow.png)
TopologyRunner Multithread Flow
![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/multi-thread-flow.png)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for openmetadata-ingestion-1.4.0.0rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42f4a32193bf219cef75d4d083e7611039a7036d546d57cd1fc132e0b7cdfbb1 |
|
MD5 | eba32e5fb38bdd97eff8fb0fc57331bf |
|
BLAKE2b-256 | a7d122ef0740726dfbca4de6bfa2934e55f2aebed812cd7c53d8beaf59db6304 |
Hashes for openmetadata_ingestion-1.4.0.0rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e08d0ca1112efc45af451b34e13670c4d769ab9be2e9d9d35fbacae0f7151710 |
|
MD5 | f073749dcfbb7a7cb3e94b3a4d3ee33c |
|
BLAKE2b-256 | af986b5fcfbfad9b2e80afb40a2fa2cdf5731ae95f1f819988c5a2d1d8c217fa |