Skip to main content

Airflow plugins for Rekcurd

Project description

# Rekcurd-airflow
[![Build Status](](
[![PyPI version](](
[![codecov](]( "Non-generated packages only")
[![pypi supported versions](](

Airflow Plugins for [Rekcurd Dashboard](

## Environment
- Python 3.6
- apache-airflow >= 1.10.x
- Rekcurd Dashboard >= 0.4.x

## Setup
- Setup Airflow
- Setup Rekcurd Dashboard and get your access token
- Run the following commands

**Use JWT token published by Rekcurd Dashboard as REKCURD_ACCESS_TOKEN for now**

# Set the access token and airflow-rekcurd connection to airflow
# Replace the environment variables with your own values.
$ airflow variables -s rekcurd_access_token $REKCURD_ACCESS_TOKEN
$ airflow connections -a --conn_id rekcurd_dashboard \

$ pip install rekcurd-airflow

## Components
You can see example DAGs for the plugins in [here](./dags)

### Operators
- EvaluationUpdateOperator. ([Example DAG](./dags/
- ModelDeleteOperator. ([Example DAG](./dags/
- ModelEvaluateOperator. ([Example DAG](./dags/
- ModelSwitchOperator. ([Example DAG](./dags/
- ModelUpdateOperator. ([Example DAG](./dags/

[Overall Example DAG](./dags/

## Test

$ cd airflow-plugin # move to the root directory of this repo

# not necessary if you already setup airflow for this repository
$ export AIRFLOW_HOME=`pwd`
$ pip install -r test-requirements.txt
$ airflow initdb
$ fernet_key=`python -c "from cryptography.fernet import Fernet; print(Fernet.generate_key().decode())"`
$ sed -i -e "s/\(fernet_key =\).*/\1 $fernet_key/" airflow.cfg

$ python -m unittest

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rekcurd-airflow-0.1.0.tar.gz (5.8 kB view hashes)

Uploaded source

Built Distribution

rekcurd_airflow-0.1.0-py3-none-any.whl (13.8 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page