Skip to main content

Ingestion Framework for OpenMetadata

Project description

— This guide will help you setup the Ingestion framework and connectors —

![Python version 3.8+](https://img.shields.io/badge/python-3.8%2B-blue)

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

### Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors

<img referrerpolicy=”no-referrer-when-downgrade” src=”https://static.scarf.sh/a.png?x-pxid=c1a30c7c-6dc7-4928-95bf-6ee08ca6aa6a” />

### TopologyRunner

All the Ingestion Workflows run through the TopologyRunner.

The flow is depicted in the images below.

TopologyRunner Standard Flow

![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/single-thread-flow.png)

TopologyRunner Multithread Flow

![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/multi-thread-flow.png)

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openmetadata_ingestion-1.6.3.2.tar.gz (19.9 MB view details)

Uploaded Source

Built Distribution

openmetadata_ingestion-1.6.3.2-py3-none-any.whl (21.1 MB view details)

Uploaded Python 3

File details

Details for the file openmetadata_ingestion-1.6.3.2.tar.gz.

File metadata

File hashes

Hashes for openmetadata_ingestion-1.6.3.2.tar.gz
Algorithm Hash digest
SHA256 201196e3c4287c56a06f6c5c4476a96f5e555c650c0ee5b557fbc1dbc62da981
MD5 b5b4c0025111d37312d75cb023557bd9
BLAKE2b-256 63bfbba18f537fa2d0e5fe5123977170e36fe1df4679b52c69fd9d71d4cb562b

See more details on using hashes here.

File details

Details for the file openmetadata_ingestion-1.6.3.2-py3-none-any.whl.

File metadata

File hashes

Hashes for openmetadata_ingestion-1.6.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 203b1be473fd79c4b220ac74be3e6a14ee96a2b4a24df9278f81b8677940dd40
MD5 7d9e7a74eccafa62528232a93d539eda
BLAKE2b-256 3033c1582847a4568d910d2b5814c35aef220d67b861eb9dee093853fb3d6f1b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page