Skip to main content

The Apache Spark (IOMETE) adapter plugin for dbt

Project description

iomete logo dbt logo

Unit Tests Badge Release Badge

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.

dbt-iomete

The dbt-iomete package contains all the code enabling dbt to work with iomete.

This adapter is forked from the dbt-spark

Getting started

Installation

pip install dbt-iomete

Alternatively, you can install the package from GitHub with:

pip install git+https://github.com/iomete/dbt-iomete.git

Profile Setup

iomete:
  target: dev
  outputs:
    dev:
      type: iomete
      host: <host>
      port: 443
      https: true # or http
      dataplane: <iomete_dataplane>
      domain: <iomete_domain>
      lakehouse: <serverless_lakehouse_name>
      catalog: <catalog_name>
      schema: <database_name>
      user: "{{ env_var('DBT_IOMETE_USER_NAME') }}"
      token: "{{ env_var('DBT_IOMETE_TOKEN') }}"

For more information, consult the docs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt_iomete-1.7.9.tar.gz (22.2 kB view details)

Uploaded Source

File details

Details for the file dbt_iomete-1.7.9.tar.gz.

File metadata

  • Download URL: dbt_iomete-1.7.9.tar.gz
  • Upload date:
  • Size: 22.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.10

File hashes

Hashes for dbt_iomete-1.7.9.tar.gz
Algorithm Hash digest
SHA256 d62fafd0d10d9cf0fdb702714943eb4b15e4552b9f52edb572281c2a1417daf6
MD5 5270f8d1d0481052ffddeedaa6471a6a
BLAKE2b-256 c1cfd8b22e5a96a234c52ef3e476c74bb9ae728c8139380e3746661a0e351292

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page