Skip to main content

Environment variable plugin for MWAA

Project description

MWAA Environment Variable Plugin

Overview

The MwaaEnvVarPlugin is a custom Apache Airflow plugin designed for Amazon Managed Workflows for Apache Airflow (MWAA). This plugin automatically converts MWAA configuration options in the env section (e.g., env.foo_bar) into user-friendly environment variables (e.g., FOO_BAR), as opposed to the default AIRFLOW__ENV__FOO_BAR provided by vanilla MWAA.

Features

  • Automatically detects environment variables set by MWAA through configuration variables (env section).
  • Converts these variables to user-friendly names without the AIRFLOW__ENV prefix and double underscores.
  • Sets the new environment variables in the system.
  • The new variables are available in all processes (Scheduler, Worker, Webserver) and override environment variables that might have been set in startup.sh script.

Installation

  1. Simply add mwaa-env-var-plugin into your MWAA requirements.txt:
mwaa-env-var-plugin==1.0.0
  1. By default, in Apache Airflow v2, plugins are configured to be "lazily" loaded using the core.lazy_load_plugins : True setting. Make sure you add core.lazy_load_plugins : False as an Apache Airflow configuration option to load plugins at the start of each Airflow process to override the default setting.

PyPI

https://pypi.org/project/mwaa-env-var-plugin/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

mwaa_env_var_plugin-1.0.0-py3-none-any.whl (4.2 kB view details)

Uploaded Python 3

File details

Details for the file mwaa_env_var_plugin-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mwaa_env_var_plugin-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a7f8001ddeaec72980d8a78b4142f77c3fa6e43283b1fa84a28ae962204aff08
MD5 a9706a890b02253235760d0d7f866713
BLAKE2b-256 8bba4abf0cae3e3940c0f9139831e2471a717ddd0c366253231f9ac979fa1a7b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page