nyoka 1.1.0

A Python library to export Machine Learning/ Deep Learning models into PMML

Nyoka

Overview

Nyoka is a Python library for comprehensive support of the latest PMML standard plus extensions for data preprocessing, script execution and highly compacted representation of deep neural networks. Using Nyoka, Data Scientists can export a large number of Machine Learning and Deep Learning models from popular Python frameworks into PMML by either using any of the numerous included ready-to-use exporters or by creating their own exporter for specialized/individual model types by simply calling a sequence of constructors.

Besides about 500 Python classes which each cover a PMML tag and all constructor parameters/attributes as defined in the standard, Nyoka also provides an increasing number of convenience classes and functions that make the Data Scientist’s life easier for example by reading or writing any PMML file in one line of code from within your favorite Python environment.

Nyoka comes to you with the complete source code in Python, extended HTML documentation for the classes/functions, and a growing number of Jupyter Notebook tutorials that help you familiarize yourself with the way Nyoka supports you in using PMML as your favorite Data Science transport file format.

Read the documentation at Nyoka Documentation.

Folder structure

nyoka-pmml
|---nyoka
	|---docs
	|---examples
	|	|---keras
	|	|	|---(jupyter notebook examples)
	|	|---lgbm
	|	|	|---(jupyter notebook examples)
	|	|---skl
	|	|	|---(jupyter notebook examples)
	|	|---statsmodels
	|	|	|---(jupyter notebook examples)
	|	|---xgboost
	|		|---(jupyter notebook examples)
	|---nyoka
	|	|---keras
	|	|	|---keras_model_to_pmml
	|	|---lbgm
	|	|	|---tests
	|	|	|	|---lbg_test
	|	|	|---lgb_to_pmml
	|	|---skl
	|	|	|---tests
	|	|	|	|---pre_process_UnitTest
	|	|	|	|---skl_to_pmml_UnitTest
	|	|	|---pre_process
	|	|	|---skl_to_pmml
	|	|---statsmodels
	|	|	|---arima
	|	|	|---exponential_smoothing
	|	|---xgboost
	|	|	|---tests
	|	|	|	|---xgboost_Test
	|	|	|---xgboost_to_pmml
	|	|---Base64
	|	|---PMML43Ext
	|	|---PMML43ExtSuper
	|---LICENSE
	|---README
	|---setup

Prerequisites

• Python 3.x

Dependencies

nyoka requires:

• scikit-learn (>=0.19.1)
• keras (==2.1.5)
• tensorflow (==1.9.0)
• statsmodels (>=0.9.0)
• lightgbm (>=2.1.2)
• xgboost (>=0.8.0)
• sklearn-pandas

Installation

You can install nyoka using:

pip install nyoka

Usage

Nyoka to export scikit-learn models:

Exporting a Support Vector Classifier pipeline object into PMML

import pandas as pd
from sklearn import datasets
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler, Imputer
from sklearn.svm import SVC

iris = datasets.load_iris()
irisd = pd.DataFrame(iris.data,columns=iris.feature_names)
irisd['Species'] = iris.target

features = irisd.columns.drop('Species')
target = 'Species'

pipeline_obj = Pipeline([
    ('svm',SVC())
])

pipeline_obj.fit(irisd[features],irisd[target])


from nyoka import skl_to_pmml

skl_to_pmml(pipeline_obj,features,target,"svc_pmml.pmml")

Exporting a Random Forest Classifier (along with pre-processing) pipeline object into PMML

import pandas as pd
from sklearn import datasets
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler, Imputer
from sklearn_pandas import DataFrameMapper
from sklearn.ensemble import RandomForestClassifier

iris = datasets.load_iris()
irisd = pd.DataFrame(iris.data, columns=iris.feature_names)
irisd['Species'] = iris.target

features = irisd.columns.drop('Species')
target = 'Species'

pipeline_obj = Pipeline([
    ("mapping", DataFrameMapper([
    (['sepal length (cm)', 'sepal width (cm)'], StandardScaler()) , 
    (['petal length (cm)', 'petal width (cm)'], Imputer())
    ])),
    ("rfc", RandomForestClassifier(n_estimators = 100))
])

pipeline_obj.fit(irisd[features], irisd[target])


from nyoka import skl_to_pmml

skl_to_pmml(pipeline_obj, features, target, "rf_pmml.pmml")

Nyoka to export xgboost models:

Exporting a XGBoost model into PMML

import pandas as pd
from sklearn import datasets
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler
import xgboost as xgb

boston = datasets.load_boston()
y = boston['target']
X = boston['data']
xgb_model = xgb.XGBRegressor()

pipeline_obj = Pipeline([
    ("scaling", StandardScaler()),
    ("model", XGBRegressor())
])

pipeline_obj.fit(X, y)


from nyoka import xgboost_to_pmml

xgboost_to_pmml(pipeline_obj, boston.feature_names, 'target', "xgb_pmml.pmml")

Nyoka to export lightGBM models:

Exporting a LGBM model into PMML

import pandas as pd
from sklearn import datasets
from sklearn.pipeline import Pipeline
from lightgbm import LGBMRegressor,LGBMClassifier


iris = datasets.load_iris()
irisd = pd.DataFrame(iris.data,columns=iris.feature_names)
irisd['Species'] = iris.target

features = irisd.columns.drop('Species')
target = 'Species'

pipeline_obj = Pipeline([
    ('lgbmc',LGBMClassifier())
])

pipeline_obj.fit(irisd[features],irisd[target])


from nyoka import lgb_to_pmml

lgb_to_pmml(pipeline_obj,features,target,"lgbmc_pmml.pmml")

Nyoka to export keras models:

Exporting a Mobilenet model into PMML

from keras import applications
from keras.layers import Flatten, Dense
from keras.models import Model

model = applications.MobileNet(weights='imagenet', include_top=False,input_shape = (224, 224,3))

activType='sigmoid'
x = model.output
x = Flatten()(x)
x = Dense(1024, activation="relu")(x)
predictions = Dense(2, activation=activType)(x)
model_final = Model(inputs =model.input, outputs = predictions,name='predictions')

from nyoka import KerasToPmml
cnn_pmml = KerasToPmml(model_final,predictedClasses=['cats','dogs'])

cnn_pmml.export(open('2classMBNet.pmml', "w"), 0)

Uninstallation

pip uninstall nyoka

Support

You can ask questions at:

• https://stackoverflow.com by tagging your questions with #pmml, #nyoka
• You can also post bug reports in GitHub issues