Skip to main content

A Firebolt provider for Apache Airflow

Project description

Firebolt Provider for Apache Airflow

Unit tests Coverage

Screen Shot 2022-02-02 at 2 57 37 PM

This is the provider package for the firebolt provider. All classes for this provider package are in the firebolt_provider Python package.

Contents

Installation

You can install this package via

pip install airflow-provider-firebolt

airflow-provider-firebolt requires apache-airflow 2.0+ and firebolt-sdk 1.1+.

Configuration

In the Airflow user interface, configure a Connection for Firebolt. Configure the following fields:

  • Conn Id: firebolt_conn_id.
  • Conn Type: Firebolt.
  • Client ID: Service account ID.
  • Client Secret: Service account secret.
  • Engine_Name: Firebolt Engine Name.
  • Account: Name of the account you're connecting to.

Client id and secret credentials can be obtained by registering a Service account.

Note

If you're accessing Firebolt UI via app.firebolt.io then use Username and Password instead of Client ID and Client Secret to connect.

Modules

Operators

operators.firebolt.FireboltOperator runs a provided SQL script against Firebolt and returns results.

operators.firebolt.FireboltStartEngineOperator operators.firebolt.FireboltStopEngineOperator starts/stops the specified engine, and waits until it is actually started/stopped. If the engine_name is not specified, it will use the engine_name from the connection, if it also not specified it will start the default engine of the connection database. Note: start/stop operator requires actual engine name, if engine URL is specified instead, start/stop engine operators will not be able to handle it correctly.

Hooks

hooks.firebolt.FireboltHook establishes a connection to Firebolt.

Contributing

See: CONTRIBUTING.MD

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

airflow_provider_firebolt-0.5.1.tar.gz (14.9 kB view details)

Uploaded Source

Built Distribution

airflow_provider_firebolt-0.5.1-py3-none-any.whl (22.3 kB view details)

Uploaded Python 3

File details

Details for the file airflow_provider_firebolt-0.5.1.tar.gz.

File metadata

File hashes

Hashes for airflow_provider_firebolt-0.5.1.tar.gz
Algorithm Hash digest
SHA256 1ac924fe1d736077e7c94c0f31db3bfc3d65a8894441b341c91cb5b6a6cfc613
MD5 b652e92301a642f37232f7bec83892b2
BLAKE2b-256 6297ba37555944ed98d64df3a7ba505428ed88f9c22c9311141cc1e19d5fbe57

See more details on using hashes here.

File details

Details for the file airflow_provider_firebolt-0.5.1-py3-none-any.whl.

File metadata

File hashes

Hashes for airflow_provider_firebolt-0.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1f2bac5f855c2f3db5a60186f47677ff0a27a593bd629477f3ba3dbdefeb3530
MD5 6042c08482b3b77c459576a11b93e368
BLAKE2b-256 f119cd74828409391e7cb166c760ce01282b408f428ff199590aae0296deb382

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page