dbt-tidb 1.0.0

The TiDB adapter plugin for dbt

dbt-tidb

The dbt-tidb package contains all of the code enabling dbt to work with TiDB.

This repository is based on dbt-mysql. Thanks to them for their excellent work.

Table of Contents

• Installation
• Supported features
• Profile Configuration
• Database User Privileges
• Running Tests

Installation

Compile by source code.

$ git clone https://github.com/Daemonxiao/dbt-tidb.git
$ cd dbt-tidb
$ pip install .

Also, you can get it from pypi.

$ pip install dbt-tidb

Supported features

TiDB 4.X	TiDB 5.0 ~ 5.2	TiDB >= 5.3	Feature
✅	✅	✅	Table materialization
✅	✅	✅	View materialization
✅	✅	✅	Incremental materialization
❌	❌	✅	Ephemeral materialization
✅	✅	✅	Seeds
✅	✅	✅	Sources
✅	✅	✅	Custom data tests
✅	✅	✅	Docs generate
❌	❌	✅	Snapshots

Note:

• TiDB 4.0 ~ 5.0 does not support CTE, you should avoid using WITH in your SQL code.
• TiDB 4.0 ~ 5.2 does not support creating a temporary table or view.
• TiDB 4.X does not support using SQL func in CREATE VIEW, avoid it in your SQL code. You can find more detail here.

Profile Configuration

TiDB targets should be set up using the following configuration in your profiles.yml file.

Example entry for profiles.yml:

your_profile_name:
  target: dev
  outputs:
    dev:
      type: tidb
      server: 127.0.0.1
      port: 4000
      schema: database_name
      username: tidb_username
      password: tidb_password

Option	Description	Required?	Example
type	The specific adapter to use	Required	tidb
server	The server (hostname) to connect to	Required	yourorg.tidb.com
port	The port to use	Required	4000
schema	Specify the schema (database) to build models into	Required	analytics
username	The username to use to connect to the server	Required	dbt_admin
password	The password to use for authenticating to the server	Required	correct-horse-battery-staple

Database User Privileges

Your database user would be able to have some abilities to read or write, such as SELECT, CREATE, and so on. You can find some help here with TiDB privileges management.

Required Privilege
SELECT
CREATE
CREATE TEMPORARY TABLE
CREATE VIEW
INSERT
DROP
SHOW DATABASE
SHOW VIEW
SUPER

Running Tests

See test/README.md for details on running the integration tests.

Contributing

Welcome to contribute for dbt-tidb. See Contributing Guide for more information.