Environment variable plugin for MWAA
Project description
MWAA Environment Variable Plugin
Overview
The MwaaEnvVarPlugin
is a custom Apache Airflow plugin designed for Amazon Managed Workflows for Apache Airflow (MWAA).
This plugin automatically converts MWAA configuration options in the env
section (e.g., env.foo_bar
) into
user-friendly environment variables (e.g., FOO_BAR
), as opposed to the default AIRFLOW__ENV__FOO_BAR
provided
by vanilla MWAA.
Features
- Automatically detects environment variables set by MWAA through configuration variables (
env
section). - Converts these variables to user-friendly names without the
AIRFLOW__ENV
prefix and double underscores. - Sets the new environment variables in the system.
- The new variables are available in all processes (Scheduler, Worker, Webserver) and override environment variables that might have been set in
startup.sh
script.
Installation
- Simply add
mwaa-env-var-plugin
into your MWAA requirements.txt:
mwaa-env-var-plugin==1.0.0
- By default, in Apache Airflow v2, plugins are configured to be "lazily" loaded using the
core.lazy_load_plugins : True
setting. Make sure you addcore.lazy_load_plugins : False
as an Apache Airflow configuration option to load plugins at the start of each Airflow process to override the default setting.
PyPI
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file mwaa_env_var_plugin-1.0.0-py3-none-any.whl
.
File metadata
- Download URL: mwaa_env_var_plugin-1.0.0-py3-none-any.whl
- Upload date:
- Size: 4.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.0 CPython/3.10.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a7f8001ddeaec72980d8a78b4142f77c3fa6e43283b1fa84a28ae962204aff08 |
|
MD5 | a9706a890b02253235760d0d7f866713 |
|
BLAKE2b-256 | 8bba4abf0cae3e3940c0f9139831e2471a717ddd0c366253231f9ac979fa1a7b |