Skip to main content

The Apache Airflow provider package for TDengine built by SCIA IoT.

Project description

Airflow TDengine Provider

Tests CodeQL Advanced Package

The Airflow Provider for TDengine.

Usage

Build the package locally, and install it on your Airflow environment.

pip install dist/apache_airflow_providers_tdengine-0.0.1-py3-none-any.whl

Or via PyPI:

pip install apache-airflow-providers-tdengine

Add a connection to Airflow via CLI:

airflow connections add 'tdengine_default' \
  --conn-uri 'YOUR_CONN_URI_HERE'

NOTICE: The client driver taosc must be installed since only native connector i.e. tdengine is supported now.

Sample Operator

from sciaiot.airflow.providers.tdengine.operators.tdengine import BaseTDengineOperator


class CustomTDengineOperator(BaseOperator):
  def __init__(self, *, **kwargs) -> None:
    super().__init__(conn_id=conn_id, database=database, **kwargs)

  def execute(self, context: Context) -> None:
    statement = "SELECT server_status()"
    hook = self.get_hook()
    hook.run(statement=statement)
  

Development

IDE

Use devcontainer with VS Code.

Database

Run the tests/DDL.sql in taos CLI to setup a test database.

Code Style

In the root folder of project, run:

# add -v for verbose output
# add --fix for auto fixing
ruff check 

Or with the Ruff extension installed, run commands for any opening python file.

Type Check

In the root folder of project, run:

mypy .

Test

In the root folder of project, run:

pytest .

Build

In the root folder of project, run:

python -m build

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache_airflow_providers_tdengine-0.1.1.tar.gz (9.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file apache_airflow_providers_tdengine-0.1.1.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_providers_tdengine-0.1.1.tar.gz
Algorithm Hash digest
SHA256 a82a988fb2c5a46e8c6947305a38d780a399fbf4818dd35fc6663dc7303ff21f
MD5 0f725f1a0c6d42983f97ffc6996554df
BLAKE2b-256 26c681dc79f360d3293e4ec5226d02aa99b1a6721d8365e417a916a0a15f6eaf

See more details on using hashes here.

Provenance

The following attestation bundles were made for apache_airflow_providers_tdengine-0.1.1.tar.gz:

Publisher: package.yml on scia-iot/airflow-providers-tdengine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file apache_airflow_providers_tdengine-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_tdengine-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9b566b907c0c1b4795f65dab2278cc668ea448843946da702170858729d4eeeb
MD5 df93711e7235dc06661072a45ab94adc
BLAKE2b-256 9b293b3e74fdc93e7ff925b601a2e083ecb02fde987273df688d27b38d2920ac

See more details on using hashes here.

Provenance

The following attestation bundles were made for apache_airflow_providers_tdengine-0.1.1-py3-none-any.whl:

Publisher: package.yml on scia-iot/airflow-providers-tdengine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page