A collection of Python-based 'connectors' that extract metadata from various sources to ingest into the Metaphor app.
Project description
Metaphor Connectors
This repository contains a collection of Python-based "connectors" that extract metadata from various sources to ingest into the Metaphor platform.
Installation
This package requires Python 3.7+ installed. You can verify the version on your system by running the following command,
python -V # or python3 on some systems
Once verified, you can install the package using pip,
pip install "metaphor-connectors[all]" # or pip3 on some systems
This will install all the connectors and required dependencies. You can also choose to install only a subset of the dependencies by installing the specific extra, e.g.
pip install "metaphor-connectors[snowflake]"
Similarly, you can also install the package using requirements.txt
or pyproject.toml
.
Connectors
Each connector is placed under its own directory under metaphor and extends the metaphor.common.BaseExtractor
class.
Connector Name | Metadata |
---|---|
airflow_plugin | Lineage |
bigquery | Schema, description, statistics |
bigquery.lineage | Lineage |
bigquery.profile | Data profile |
bigquery.query | Queries |
bigquery.usage | Data usage |
dbt | dbt model, test, lineage |
dbt.cloud | dbt model, test, lineage |
glue | Schema, description |
looker | Looker view, explore, dashboard, lineage |
manual.metadata | Custom metadata |
manual.governance | Ownership, tags |
manual.lineage | Lineage |
metabase | Dashboard, lineage |
postgresql | Schema, description, statistics |
postgresql.profile | Data profile |
postgresql.usage | Usage |
power_bi | Dashboard, lineage |
redshift | Schema, description, statistics |
redshift.lineage | Lineage |
redshift.profile | Data profile |
redshift.query | Queries |
redshift.usage | Usage |
snowflake | Schema, description, statistics |
snowflake.lineage | Lineage |
snowflake.profile | Data profile |
snowflake.query | Queries |
snowflake.usage | Data usage |
tableau | Dashboard, lineage |
unity_catalog | Schema, description |
Development
See Development Environment for more instructions on how to setup your local development environment.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for metaphor-connectors-0.11.48.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 34d3e70d2b24ee309159045f830afa661a7231f0e4ddadcd2ec46ea13884c193 |
|
MD5 | 8b65503b0f217a4d2b32cf07ff02feaf |
|
BLAKE2b-256 | c77f3bcb32de2e618a7f9d776a43b7fca0af4848296e643d45e12151eadef009 |
Hashes for metaphor_connectors-0.11.48-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 66f8b68ab93084f5abadbfae0e8983a6dc66f7e915aca3bdad35ae9fe598fb4f |
|
MD5 | def746d13856e8da33ec1847a450dedc |
|
BLAKE2b-256 | 6d89a90b2674ffc4e4d92e5db2688b1ba37011e8977820af9a9a557637ec7cd5 |