Skip to main content

The Apache Spark (iomete) adapter plugin for dbt

Project description

iomete logo dbt logo

Unit Tests Badge Release Badge

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

dbt-iomete

The dbt-iomete package contains all the code enabling dbt to work with iomete.

This adapter is forked from the dbt-spark

Getting started

Installation

pip install dbt-iomete

Alternatively, you can install the package from GitHub with:

pip install git+https://github.com/iomete/dbt-iomete.git

Profile Setup

iomete:
  target: dev
  outputs:
    dev:
      type: iomete
      account_number: <iomete_account_number>
      lakehouse: <serverless_lakehouse_name>
      host: <host>
      port: 443
      schema: <database_name>
      user: "{{ env_var('DBT_USER') }}"
      password: "{{ env_var('DBT_PASSWORD') }}"

For more information, consult the docs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt-iomete-1.4.0.tar.gz (19.1 kB view hashes)

Uploaded source

Built Distribution

dbt_iomete-1.4.0-py3-none-any.whl (22.3 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page