A Firebolt provider for Apache Airflow
Project description
Firebolt Provider for Apache Airflow
This is the provider package for the firebolt
provider. All classes for this provider package are in the firebolt_provider
Python package.
Contents
Installation
You can install this package via
pip install airflow-provider-firebolt
airflow-provider-firebolt
requires apache-airflow
2.0+ and firebolt-sdk
1.1+.
Configuration
In the Airflow user interface, configure a Connection for Firebolt. Configure the following fields:
Conn Id
:firebolt_conn_id
.Conn Type
:Firebolt
.Client ID
: Service account ID.Client Secret
: Service account secret.Engine_Name
: Firebolt Engine Name.Account
: Name of the account you're connecting to.
Client id and secret credentials can be obtained by registering a Service account.
Note
If you're accessing Firebolt UI via app.firebolt.io
then use Username and Password instead of Client ID and Client Secret to connect.
Modules
Operators
operators.firebolt.FireboltOperator runs a provided SQL script against Firebolt and returns results.
operators.firebolt.FireboltStartEngineOperator
operators.firebolt.FireboltStopEngineOperator starts/stops the specified engine, and waits until it is actually started/stopped. If the engine_name
is not specified, it will use the engine_name
from the connection, if it also not specified it will start the default engine of the connection database. Note: start/stop operator requires actual engine name, if engine URL is specified instead, start/stop engine operators will not be able to handle it correctly.
Hooks
hooks.firebolt.FireboltHook establishes a connection to Firebolt.
Contributing
See: CONTRIBUTING.MD
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file airflow_provider_firebolt-0.5.1.tar.gz
.
File metadata
- Download URL: airflow_provider_firebolt-0.5.1.tar.gz
- Upload date:
- Size: 14.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ac924fe1d736077e7c94c0f31db3bfc3d65a8894441b341c91cb5b6a6cfc613 |
|
MD5 | b652e92301a642f37232f7bec83892b2 |
|
BLAKE2b-256 | 6297ba37555944ed98d64df3a7ba505428ed88f9c22c9311141cc1e19d5fbe57 |
File details
Details for the file airflow_provider_firebolt-0.5.1-py3-none-any.whl
.
File metadata
- Download URL: airflow_provider_firebolt-0.5.1-py3-none-any.whl
- Upload date:
- Size: 22.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1f2bac5f855c2f3db5a60186f47677ff0a27a593bd629477f3ba3dbdefeb3530 |
|
MD5 | 6042c08482b3b77c459576a11b93e368 |
|
BLAKE2b-256 | f119cd74828409391e7cb166c760ce01282b408f428ff199590aae0296deb382 |