The Apache Spark (IOMETE) adapter plugin for dbt
Project description
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
dbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.
dbt-iomete
The dbt-iomete
package contains all the code enabling dbt to work with iomete.
This adapter is forked from the dbt-spark
Getting started
Installation
pip install dbt-iomete
Alternatively, you can install the package from GitHub with:
pip install git+https://github.com/iomete/dbt-iomete.git
Profile Setup
iomete:
target: dev
outputs:
dev:
type: iomete
host: <host>
port: 443
https: true # or http
dataplane: <iomete_dataplane>
lakehouse: <serverless_lakehouse_name>
schema: <database_name>
user: "{{ env_var('DBT_IOMETE_USER_NAME') }}"
token: "{{ env_var('DBT_IOMETE_TOKEN') }}"
For more information, consult the docs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file dbt_iomete-1.7.3.tar.gz
.
File metadata
- Download URL: dbt_iomete-1.7.3.tar.gz
- Upload date:
- Size: 21.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 25e6b54c4386316bfc33ce3306c50c8681c7fbc4d6cedad275d06e10060378ad |
|
MD5 | a6345a0172797ca87aaf9c05303d152c |
|
BLAKE2b-256 | e6258dd5607c35714da5011ab5e4b608204986ae912e898379cdac00594fe230 |
File details
Details for the file dbt_iomete-1.7.3-py3-none-any.whl
.
File metadata
- Download URL: dbt_iomete-1.7.3-py3-none-any.whl
- Upload date:
- Size: 24.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d0182a38d977a41441600f0aaa31dd4a65a9d4da6842be4adf8255a662db56e |
|
MD5 | 6d7f18ea3326b154aa110f14c8b0568f |
|
BLAKE2b-256 | bb153d8feb0cf98349feea91f44918b75d3608f2266759f3b1ef077148ea1716 |