Airflow TDengine Provider

The Airflow Provider for TDengine.

Usage

Build the package locally, and install it on your Airflow environment.

pip install dist/sciaiot_airflow_providers_tdengine-0.1.2-py3-none-any.whl

Or via PyPI:

pip install sciaiot-airflow-providers-tdengine

Add a connection to Airflow via CLI:

airflow connections add 'tdengine_default' --conn-uri 'tdengine://root:taosdata@tdengine:6030'

Test it:

airflow connections test tdengine_default

NOTICE: The client driver taosc must be installed since only native connector i.e. tdengine is supported now.

Sample Operator

from sciaiot.airflow.providers.tdengine.operators.tdengine import BaseTDengineOperator


class CustomTDengineOperator(BaseOperator):
  def __init__(self, *, **kwargs) -> None:
    super().__init__(conn_id=conn_id, database=database, **kwargs)

  def execute(self, context: Context) -> None:
    statement = "SELECT server_status()"
    hook = self.get_hook()
    hook.run(statement=statement)
  

Development

IDE

Use devcontainer with VS Code.

Database

Run the tests/DDL.sql in taos CLI to setup a test database.

Code Style

In the root folder of project, run:

# add -v for verbose output
# add --fix for auto fixing
ruff check 

Or with the Ruff extension installed, run commands for any opening python file.

Type Check

In the root folder of project, run:

mypy .

Install

In the root folder of project, run:

pip install -e .

Test

In the root folder of project, run:

pytest .

Build

Add build package:

pip install build

In the root folder of project, run:

python -m build