Skip to main content

Environment variable plugin for MWAA

Project description

MWAA Environment Variable Plugin

Overview

The MwaaEnvVarPlugin is a custom Apache Airflow plugin designed for Amazon Managed Workflows for Apache Airflow (MWAA). This plugin automatically converts MWAA configuration options in the env section (e.g., env.foo_bar) into user-friendly environment variables (e.g., FOO_BAR), as opposed to the default AIRFLOW__ENV__FOO_BAR provided by vanilla MWAA.

Features

  • Automatically detects environment variables set by MWAA through configuration variables (env section).
  • Converts these variables to user-friendly names without the AIRFLOW__ENV prefix and double underscores.
  • Sets the new environment variables in the system.
  • The new variables are available in all processes (Scheduler, Worker, Webserver) and override environment variables that might have been set in startup.sh script.

Installation

  1. Simply add mwaa-env-var-plugin into your MWAA requirements.txt:
mwaa-env-var-plugin==1.0.0
  1. By default, in Apache Airflow v2, plugins are configured to be "lazily" loaded using the core.lazy_load_plugins : True setting. Make sure you add core.lazy_load_plugins : False as an Apache Airflow configuration option to load plugins at the start of each Airflow process to override the default setting.

PyPI

https://pypi.org/project/mwaa-env-var-plugin/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

mwaa_env_var_plugin-1.0.0-py3-none-any.whl (4.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page