kowalsky 0.0.20

A small package for all useful ML things

Kowalsky, analysis!

A simple package for handful ML things and more.

What's new? [v0.0.20]

• add apply_with_progress for ability to track the progress of dataframe transformation
• improve optimize:
  • EarlyStopping mechanism
  • optimization graph
  • multitasks with n_jobs=-1

What's inside?

1. analysis - method for evaluation of specified model with given dataframe. With export_test_set=True it exports ready for submission predictions.

2. df - module for working with dataframe:

   • corr - sort all correlated features.
   • handle_outliers - fill or drop columns with outliers.
   • log_transform - transform columns with log function.
   • group_by_mean - make additional columns with aggregated mean
   • group_by_max - make additional columns with aggregated max
   • group_by_min - make additional columns with aggregated min
   • apply_with_progress - apply heavy function for each row of dataset.
   • scale - scale columns with Standard of MinMax scalers

3. kaggle:

   • submit - make submit-file for kaggle based on sample

4. metrics:

   • rmse - RMSE scorer
   • rmsle - RMSLE scorer

5. optuna - handful methods for working with optuna:

   • optimize - optimize model with given dataframe
   • optimize_super_learner - optimize super learner configuration with given set of models and set of heads (meta_model)

6. colab:

   • csv - read csv file located at Google Drive with specified id
   • path - get path to Google Drive file

Example:

!pip install kowalsky --upgrade

from kowalsky.optuna import optimize
from kowalsky.colab import path

optimize('LGBR',
         path=path('1mwI9YP8SuDdWl6vU8Yp-Dv-9hgyKR_HS'),
         direction='minimize',
         scorer='rmsle',
         y_label='count',
         trials=3000)

Avaliable models:

Gradient Boosts

    'XGBR': XGBRegressor
    'XGBC': XGBClassifier
    'LGBR': LGBMRegressor
    'LGBC': LGBMClassifier

Trees

    'RFR': RandomForestRegressor
    'RFC': RandomForestClassifier
    'DTR': DecisionTreeRegressor
    'DTC': DecisionTreeClassifier
    'ETR': ExtraTreeRegressor
    'ETC': ExtraTreeClassifier

Ensemble

    'BC': BaggingClassifier
    'BR': BaggingRegressor
    'ADAR': AdaBoostRegressor
    'ADAC': AdaBoostClassifier
    'CBR': CatBoostRegressor
    'CBC': CatBoostClassifier

KNeighbors

    'KNC': KNeighborsClassifier
    'KNR': KNeighborsRegressor

SVM

    'SVR': SVR
    'SVC': SVC