Skip to main content

The Apache Spark (IOMETE) adapter plugin for dbt

Project description

iomete logo dbt logo

Unit Tests Badge Release Badge

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

dbt-iomete

The dbt-iomete package contains all the code enabling dbt to work with iomete.

This adapter is forked from the dbt-spark

Getting started

Installation

pip install dbt-iomete

Alternatively, you can install the package from GitHub with:

pip install git+https://github.com/iomete/dbt-iomete.git

Profile Setup

iomete:
  target: dev
  outputs:
    dev:
      type: iomete
      host: <host>
      port: 443
      https: true # or http
      dataplane: <iomete_dataplane>
      domain: <iomete_domain>
      lakehouse: <serverless_lakehouse_name>
      schema: <database_name>
      user: "{{ env_var('DBT_IOMETE_USER_NAME') }}"
      token: "{{ env_var('DBT_IOMETE_TOKEN') }}"

For more information, consult the docs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_iomete-1.7.5.tar.gz (21.3 kB view details)

Uploaded Source

File details

Details for the file dbt_iomete-1.7.5.tar.gz.

File metadata

  • Download URL: dbt_iomete-1.7.5.tar.gz
  • Upload date:
  • Size: 21.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for dbt_iomete-1.7.5.tar.gz
Algorithm Hash digest
SHA256 751d88b7d84793de3c6faa64019b3ece867b92c3d8737b17a46ee33d25877650
MD5 a713fb81a8cdd23432ecae8cdcb2e375
BLAKE2b-256 d8d441f8fd79e3ea286edeedc6161b66a01226afa18b84ebff9f28f0c1c7a4c0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page