The starrocks adapter plugin for dbt
Project description
dbt-starrocks
This project is under development.
The dbt-starrocks
package contains all of the code enabling dbt to work with a StarRocks database. For
more information on using dbt with StarRocks.
Getting started
Configuration your envs:
- Python: 3.7.4
- StarRocks: 2.4.0+
- DBT: 1.1.0
Install the dbt-starrocks
into the plugin
directory, and
pip install .
Create your project:
dbt init
Basic Example
dbt seed properties(yml):
Minimum configuration:
config:
distributed_by: ['id']
Complete configuration:
config:
engine: 'OLAP'
keys: ['id', 'name', 'some_date']
table_type: 'PRIMARY' //PRIMARY or DUPLICATE or UNIQUE
distributed_by: ['id']
buckets: 3 //default 10
partition_by: ['some_date']
partition_by_init: ["PARTITION p1 VALUES [('1971-01-01 00:00:00'), ('1991-01-01 00:00:00')),PARTITION p1972 VALUES [('1991-01-01 00:00:00'), ('1999-01-01 00:00:00'))"]
properties: {"replication_num":"1", "in_memory": "true"}
dbt run config(table/incremental):
Minimum configuration:
{{ config(materialized=var("materialized_var", "table"), distributed_by=['id'])}}
{{ config(materialized='incremental', distributed_by=['id']) }}
Complete configuration:
{{ config(materialized='table', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
{{ config(materialized='incremental', engine='OLAP', buckets=32, distributed_by=['id'], properties={"in_memory": "true"}) }}
Test Adapter
consult the project
Notice
Create table as
can only set engine='OLAP' and table_type='DUPLICATE'- distributed_by is must
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for dbt-dataops-starrocks-1.4.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9136177d1f31a79b98efd6f58d944caa412370f3ea3859a4c449865949d8f640 |
|
MD5 | f6eed90d793835ec7debf78bf3658a97 |
|
BLAKE2b-256 | 0513f6a53842b52c37f7979eb7032178df2a5b9a1832e2e2bfd73381629a29ad |
Close
Hashes for dbt_dataops_starrocks-1.4.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4b5e5ca5f23011eeae6fbb702ac9f13f3be00afd8ab69e726d33907d6f0ade8c |
|
MD5 | fa0f3814c603f331b3ec47299a4c9264 |
|
BLAKE2b-256 | 8188952fc091d107cee1853a8890dbf43638fe5c78b93195893aa512682f48c4 |