sciaiot-airflow-providers-tdengine 0.1.6

The Apache Airflow provider package for TDengine built by SCIA IoT.

Airflow TDengine Provider

The Airflow Provider for TDengine.

Usage

Build the package locally, and install it on your Airflow environment.

pip install dist/sciaiot_airflow_providers_tdengine-0.1.2-py3-none-any.whl

Or via PyPI:

pip install sciaiot-airflow-providers-tdengine

Add a connection to Airflow via CLI:

airflow connections add 'tdengine_default' --conn-uri 'tdengine://root:taosdata@tdengine:6030'

Test it:

airflow connections test tdengine_default

NOTICE: The client driver taosc must be installed since only native connector i.e. tdengine is supported now.

Sample Operator

from sciaiot.airflow.providers.tdengine.operators.tdengine import BaseTDengineOperator


class CustomTDengineOperator(BaseOperator):
  def __init__(self, *, **kwargs) -> None:
    super().__init__(conn_id=conn_id, database=database, **kwargs)

  def execute(self, context: Context) -> None:
    statement = "SELECT server_status()"
    hook = self.get_hook()
    hook.run(statement=statement)
  

Development

IDE

Use devcontainer with VS Code.

Database

Run the tests/DDL.sql in taos CLI to setup a test database.

Code Style

In the root folder of project, run:

# add -v for verbose output
# add --fix for auto fixing
ruff check 

Or with the Ruff extension installed, run commands for any opening python file.

Type Check

In the root folder of project, run:

mypy .

Install

In the root folder of project, run:

pip install -e .

Test

In the root folder of project, run:

pytest .

Build

Add build package:

pip install build

In the root folder of project, run:

python -m build