AIscalate your Jupyter Notebook Prototypes into Airflow Data Products
Project description
AIscalator
Free software: Apache Software License 2.0
Website: http://www.aiscalate.com
Documentation: https://aiscalator.readthedocs.io.
Key Features
Aiscalator is a toolbox to enable your team streamlining processes from innovation to productization with:
- Jupyter workbench
Explore Data, Prototype Solutions
- Docker wrapper tools
Share Code, Deploy Reproducible Environments
- Airflow machinery
Schedule Tasks, Refine Products
Data Science and Data Engineering best practices
Quick Start
Installation
Test if prerequisite softwares are installed:
docker --version
docker-compose --version
pip --version
Install AIscalator tool:
pip install aiscalator
Download docker image to run Jupyter:
aiscalator jupyter setup
Download docker image to run Airflow:
aiscalator airflow setup
Jupyter
Create a new Jupyter notebook to work on, define corresponding aiscalator step:
aiscalator jupyter new
Run the step without GUI:
aiscalator jupyter run <aiscalator step>
Airflow
Start Airflow services:
aiscalator airflow start
Create a new AIscalator job, define the airflow DAG:
aiscalator airflow new
Schedule AIscalator job:
aiscalator airflow push <aiscalator DAG>
History
0.1.0 (2018-11-07)
First Alpha release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for aiscalator-0.1.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6cf9f805c0def651c98f016580ea046f045e83bf5e2fe10797fab5c0c131d243 |
|
MD5 | f356828e43da5f094e8b3b172c8e6d51 |
|
BLAKE2b-256 | 7e6cd33d80cb0f44c031894ccee485102de6847d5c8b2f777d5872a26988ced0 |