The starrocks adapter plugin for dbt
Project description
dbt-starrocks
This project is under development.
The dbt-starrocks
package contains all of the code enabling dbt to work with a StarRocks database. For
more information on using dbt with StarRocks.
Getting started
Configuration your envs:
- Python: 3.7.4
- StarRocks: 2.4.0+
- DBT: 1.1.0
Install the dbt-starrocks
into the plugin
directory, and
pip install .
Create your project:
dbt init
Basic Example
dbt seed properties(yml):
Minimum configuration:
config:
distributed_by: ['id']
Complete configuration:
config:
engine: 'OLAP'
keys: ['id', 'name', 'some_date']
table_type: 'PRIMARY' //PRIMARY or DUPLICATE or UNIQUE
distributed_by: ['id']
buckets: 3 //default 10
partition_by: ['some_date']
partition_by_init: ["PARTITION p1 VALUES [('1971-01-01 00:00:00'), ('1991-01-01 00:00:00')),PARTITION p1972 VALUES [('1991-01-01 00:00:00'), ('1999-01-01 00:00:00'))"]
properties: {"replication_num":"1", "in_memory": "true"}
dbt run config(table/incremental):
Minimum configuration:
{{ config(materialized=var("materialized_var", "table"), distributed_by=['id'])}}
{{ config(materialized='incremental', distributed_by=['id']) }}
Complete configuration:
{{ config(materialized='table', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
{{ config(materialized='incremental', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
Test Adapter
consult the project
Notice
Create table as
can only set engine='OLAP' and table_type='DUPLICATE'- distributed_by is must
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbt-dataops-starrocks-1.4.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f75ac279079e867c1781d25b153e81c29ea68929cd13d46860a6b2d6d4ffe4a |
|
MD5 | 498918b14b32dff2388246f006a78f9c |
|
BLAKE2b-256 | 3ab26c6f725abec8ccc5746756bfc615730ebe401500a94fd0b6736fe49ee85e |
Close
Hashes for dbt_dataops_starrocks-1.4.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8f79635e17d8e6311fabb640b466418a09e6392747ee38290b8be222b716847b |
|
MD5 | 6a3900baf10da4b43aef5fec37af9077 |
|
BLAKE2b-256 | be5d23307810f16e4a1a7992a640718b946a35b813982a71b072eeb291f7d4a8 |