Skip to main content

AIscalate your Jupyter Notebook Prototypes into Airflow Data Products

Project description

AIscalator

https://img.shields.io/pypi/v/aiscalator.svg https://img.shields.io/travis/Aiscalate/aiscalator.svg Documentation Status Requirements Status

Key Features

Aiscalator is a toolbox to enable your team streamlining processes from innovation to productization with:

  • Jupyter workbench
    • Explore Data, Prototype Solutions

  • Docker wrapper tools
    • Share Code, Deploy Reproducible Environments

  • Airflow machinery
    • Schedule Tasks, Refine Products

  • Data Science and Data Engineering best practices

aiscalator_process.png

Quick Start

Installation

Test if prerequisite softwares are installed:

docker --version
docker-compose --version
pip --version

Install AIscalator tool:

pip install aiscalator

Download docker image to run Jupyter:

aiscalator jupyter setup

Download docker image to run Airflow:

aiscalator airflow setup

Jupyter

Create a new Jupyter notebook to work on, define corresponding aiscalator step:

aiscalator jupyter new

Run the step without GUI:

aiscalator jupyter run <aiscalator step>

Airflow

Start Airflow services:

aiscalator airflow start

Create a new AIscalator job, define the airflow DAG:

aiscalator airflow new

Schedule AIscalator job:

aiscalator airflow push <aiscalator DAG>

History

0.1.0 (2018-11-07)

  • First Alpha release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiscalator-0.1.0.tar.gz (38.7 kB view hashes)

Uploaded Source

Built Distribution

aiscalator-0.1.0-py2.py3-none-any.whl (34.3 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page