airflow-plugin-config-storage

Inject connections into the airflow database from configuration

Quickstart

Basic

$ pip install airflow-plugin-config-storage
$ export AIRFLOW_CONN_POSTGRES_MASTER=postgres://username:password@my.db.example.com/my-schema
$ load-airflow-conf-env-var
$ airflow webserver

Common

CLI Commands

delete-all-airflow-connnections

Removes all the connections from Airflow. Used to clean out the default connections.

Environment Variables

Structure

The Environment Variables to read from by default are the same as those defined in the Airflow documentation.

CLI Commands

load-airflow-conf-env-var

Takes a single optional argument --env-var-prefix ENV_VAR_PREFIX to override the Environment Variable prefix. Default is AIRLFOW_CONN_.

AWS

NOTE: Not yet implemented, these are proposals

SSM

Hierarchy

• /${user_prefix}/airflow/connections/

  [
      {
          "conn_type": "s3",
  
      },
      {}
  ]
  

• /${user_prefix}/airflow/