The starrocks adapter plugin for dbt
Project description
dbt-starrocks
This project is under development.
The dbt-starrocks
package contains all of the code enabling dbt to work with a StarRocks database. For
more information on using dbt with StarRocks.
Getting started
Configuration your envs:
- Python: 3.7.4
- StarRocks: 2.4.0+
- DBT: 1.1.0
Install the dbt-starrocks
into the plugin
directory, and
pip install .
Create your project:
dbt init
Basic Example
dbt seed properties(yml):
Minimum configuration:
config:
distributed_by: ['id']
Complete configuration:
config:
engine: 'OLAP'
keys: ['id', 'name', 'some_date']
table_type: 'PRIMARY' //PRIMARY or DUPLICATE or UNIQUE
distributed_by: ['id']
buckets: 3 //default 10
partition_by: ['some_date']
partition_by_init: ["PARTITION p1 VALUES [('1971-01-01 00:00:00'), ('1991-01-01 00:00:00')),PARTITION p1972 VALUES [('1991-01-01 00:00:00'), ('1999-01-01 00:00:00'))"]
properties: {"replication_num":"1", "in_memory": "true"}
dbt run config(table/incremental):
Minimum configuration:
{{ config(materialized=var("materialized_var", "table"), distributed_by=['id'])}}
{{ config(materialized='incremental', distributed_by=['id']) }}
Complete configuration:
{{ config(materialized='table', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
{{ config(materialized='incremental', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
Test Adapter
consult the project
Notice
Create table as
can only set engine='OLAP' and table_type='DUPLICATE'- distributed_by is must
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbt-dataops-starrocks-1.4.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b2fbe8decedd13293989a738db7b2470e7dc8535aa62f460067b2b4e5dd5966d |
|
MD5 | c82885e26c3f1448cd0264517e02eea0 |
|
BLAKE2b-256 | 6d3f96bc28c9fb65ba1138609e3910728c4366a363d0ea058afc4fe8adf368b6 |
Close
Hashes for dbt_dataops_starrocks-1.4.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 43182c8e5fb489c0ef438eb7b529af94c732c9d02a6792b4905fc4b0909db1ee |
|
MD5 | 933ea642bd0fa0c8f3931ff341668ad8 |
|
BLAKE2b-256 | 8a0bbcf01887650cb8cd60d66d180c229dd94a2c6e4c10fd325f4426b12b530c |