tidbcloudlake-dbt
The tidbcloudlake-dbt package contains all of the code enabling dbt to work with
TiDB Cloud Lake. It talks to the server through
tidbcloudlake-driver.
Table of Contents
Installation
From PyPI:
$ pip install tidbcloudlake-dbt
Or from source:
$ git clone https://github.com/tidbcloud/lake-dbt.git
$ cd lake-dbt
$ pip install .
Supported features
| ok | Feature |
|---|---|
| ✅ | Table materialization |
| ✅ | View materialization |
| ✅ | Incremental materialization |
| ❌ | Ephemeral materialization |
| ✅ | Seeds |
| ✅ | Sources |
| ✅ | Custom data tests |
| ✅ | Docs generate |
| ✅ | Snapshots |
| ✅ | Connection retry |
Note:
Ephemeralmaterialization is not supported.- In
dbt docs generate, views have no owner -- the server records one when a table is created but not when a view is.
Profile Configuration
TiDB Cloud Lake targets should be set up using the following configuration in your profiles.yml file.
Example entry for profiles.yml:
Your_Profile_Name:
target: dev
outputs:
dev:
type: tidbcloudlake
host: [host]
port: [port]
schema: [schema(Your database)]
user: [username]
pass: [password]
warehouse: [warehouse]
secure: [SSL]
| Option | Description | Required? | Example |
|---|---|---|---|
| type | The specific adapter to use | Required | tidbcloudlake |
| host | The server (hostname) to connect to | Required | tnxxxx.gw.aws-us-east-2.default.tidbcloud.com |
| port | The port to use | Required | 443 |
| schema | Specify the schema (database) to build models into | Required | analytics |
| user | The username to use to connect to the server | Required | dbt_admin |
| pass | The password to use for authenticating to the server | Required | correct-horse-battery-staple |
| warehouse | The warehouse to run queries in | Optional | default |
| secure | Whether to connect over TLS (default as True) | Optional | True |
These options are assembled into a lakesql DSN of the form
lake://user:pass@host:port/schema?sslmode=require. See the
DSN reference for the full list of
supported arguments.
Running Tests
See tests/README.md for details on running the integration tests.
Contributing
Welcome to contribute for tidbcloudlake-dbt. See Contributing Guide for more information.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tidbcloudlake_dbt-1.8.1.tar.gz.
File metadata
- Download URL: tidbcloudlake_dbt-1.8.1.tar.gz
- Upload date:
- Size: 24.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ed4d82018382f0e804c6855b5181161015c5084c610423a8613d21f4f6c2375f
|
|
| MD5 |
4003058951da1c5d9e62b5a96d96c49e
|
|
| BLAKE2b-256 |
fa9d9047506d630f7d420506d065f1ca04c318274fd4f3d36b2a057f19e3b63d
|
Provenance
The following attestation bundles were made for tidbcloudlake_dbt-1.8.1.tar.gz:
Publisher:
release.yml on tidbcloud/lake-dbt
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
tidbcloudlake_dbt-1.8.1.tar.gz -
Subject digest:
ed4d82018382f0e804c6855b5181161015c5084c610423a8613d21f4f6c2375f - Sigstore transparency entry: 2416691780
- Sigstore integration time:
-
Permalink:
tidbcloud/lake-dbt@552a67a115e07e8ce9ce56883ce20466029104dc -
Branch / Tag:
refs/tags/v1.18.1 - Owner: https://github.com/tidbcloud
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@552a67a115e07e8ce9ce56883ce20466029104dc -
Trigger Event:
release
-
Statement type:
File details
Details for the file tidbcloudlake_dbt-1.8.1-py3-none-any.whl.
File metadata
- Download URL: tidbcloudlake_dbt-1.8.1-py3-none-any.whl
- Upload date:
- Size: 28.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
edf1d73be00c2e52a3d0216be4fc4fe9c519bb9938530ee2571e803e235dc7b1
|
|
| MD5 |
ec338f007c29502b6208cb781c05a2e3
|
|
| BLAKE2b-256 |
a74834e912b921839e80f6d722136e9624ab89fe899aa3aef6c781ec56c99a2e
|
Provenance
The following attestation bundles were made for tidbcloudlake_dbt-1.8.1-py3-none-any.whl:
Publisher:
release.yml on tidbcloud/lake-dbt
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
tidbcloudlake_dbt-1.8.1-py3-none-any.whl -
Subject digest:
edf1d73be00c2e52a3d0216be4fc4fe9c519bb9938530ee2571e803e235dc7b1 - Sigstore transparency entry: 2416692130
- Sigstore integration time:
-
Permalink:
tidbcloud/lake-dbt@552a67a115e07e8ce9ce56883ce20466029104dc -
Branch / Tag:
refs/tags/v1.18.1 - Owner: https://github.com/tidbcloud
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@552a67a115e07e8ce9ce56883ce20466029104dc -
Trigger Event:
release
-
Statement type: