Skip to main content

Environment variable plugin for MWAA

Project description

MWAA Environment Variable Plugin

Overview

The MwaaEnvVarPlugin is a custom Apache Airflow plugin designed for Amazon Managed Workflows for Apache Airflow (MWAA). This plugin automatically converts MWAA configuration options in the env section (e.g., env.foo_bar) into user-friendly environment variables (e.g., FOO_BAR), as opposed to the default AIRFLOW__ENV__FOO_BAR provided by vanilla MWAA.

Features

  • Automatically detects environment variables set by MWAA through configuration variables (env section).
  • Converts these variables to user-friendly names without the AIRFLOW__ENV prefix and double underscores.
  • Sets the new environment variables in the system.
  • The new variables are available in all processes (Scheduler, Worker, Webserver) and override environment variables that might have been set in startup.sh script.

Installation

  1. Simply add mwaa-env-var-plugin into your MWAA requirements.txt:
mwaa-env-var-plugin==1.0.0
  1. By default, in Apache Airflow v2, plugins are configured to be "lazily" loaded using the core.lazy_load_plugins : True setting. Make sure you add core.lazy_load_plugins : False as an Apache Airflow configuration option to load plugins at the start of each Airflow process to override the default setting.

PyPI

https://pypi.org/project/mwaa-env-var-plugin/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mwaa_env_var_plugin-1.0.1-py3-none-any.whl (4.2 kB view details)

Uploaded Python 3

File details

Details for the file mwaa_env_var_plugin-1.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mwaa_env_var_plugin-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b79146ce356bb0da9877fd56718dcc60eee393c2c072d203af77b25d458db006
MD5 1be6cd3490a59dacbd9aa3e0f7d5f4e1
BLAKE2b-256 fc5be25e41f6f07d5888ca373cfa2863bb36a0cf407a991060fdc89808323009

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page