Skip to main content

Ingestion Framework for OpenMetadata

Project description

— This guide will help you setup the Ingestion framework and connectors —

![Python version 3.8+](https://img.shields.io/badge/python-3.8%2B-blue)

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

### Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors

<img referrerpolicy=”no-referrer-when-downgrade” src=”https://static.scarf.sh/a.png?x-pxid=c1a30c7c-6dc7-4928-95bf-6ee08ca6aa6a” />

### TopologyRunner

All the Ingestion Workflows run through the TopologyRunner.

The flow is depicted in the images below.

TopologyRunner Standard Flow

![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/single-thread-flow.png)

TopologyRunner Multithread Flow

![image](../openmetadata-docs/images/v1.4/features/ingestion/workflows/metadata/multithreading/multi-thread-flow.png)

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openmetadata_ingestion-1.8.1.0.tar.gz (20.0 MB view details)

Uploaded Source

Built Distribution

openmetadata_ingestion-1.8.1.0-py3-none-any.whl (21.3 MB view details)

Uploaded Python 3

File details

Details for the file openmetadata_ingestion-1.8.1.0.tar.gz.

File metadata

  • Download URL: openmetadata_ingestion-1.8.1.0.tar.gz
  • Upload date:
  • Size: 20.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.18

File hashes

Hashes for openmetadata_ingestion-1.8.1.0.tar.gz
Algorithm Hash digest
SHA256 b54844377f552724fc890e5b2fb045fc91fec1c5d93fb814f165ef9c4de44e1a
MD5 96e4c9a95cd847373f2e88e11aa081cb
BLAKE2b-256 a4cbc6f59f6916bc79cee292d6da370381c9f1da21655099027520c337315205

See more details on using hashes here.

File details

Details for the file openmetadata_ingestion-1.8.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for openmetadata_ingestion-1.8.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 91dc2f6a8565873321f2b0f1cd35416bc06e44d42f0057b98acbf582cbe113c6
MD5 63b1d07ed6ddfa4c2d92004b9e88f7c4
BLAKE2b-256 fdd9ec92e0397fbcd6d2ce60db0961c53674c5218f42b377f5e68284b22a809f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page