airtel-airflow-plugins 1.5.0

DARTS airflow plugins containing custom operators, sensors, callbacks and hooks

##### Airtel Airflow Plugins Library

##### Table of Contents

Overview Setup Usage

Overview Airtel Airflow Plugins Library containing all custom operators, sensors, callbacks and hooks.

Setup first create virtual env in your local setup - Note - make sure to create virtual env ending with _venv so the at the time of pushing code to git it must be ignored. python3 -m venv <virtual_env_name_venv> source <virtual_env_name_venv>/bin/activate Change the interpreter setting in your IDE to point it to correct virtual env

First, clone this repo to your local system. After you clone the repo, make sure to run the setup.py file, so you can install any dependencies you may need. To run the setup.py file, run the following command in your terminal.

Run requirement.txt in your virtual env. This will install all the dependencies listed in the requirements.txt file pip install -r requirements.txt

Below command will create wheel file. python setup.py bdist_wheel

Please make sure to have .pypirc file in your local home directory. We have attached sample in project home dir as well. This file contains repository url along with credential which we would be needing while running below command to publish the package on PYPI repository.

Below command will publish the package on PyPI repository twine upload –repository nexus dist/*

Usage The plugins package can be used in any Airflow setup for custom modules (Operators / Plugins / Sensors / Callbacks).