recipies 1.0

A modular preprocessing package for Pandas Dataframe

🥧ReciPys🐍

The ReciPys package is a preprocessing framework operating on Pandas dataframes. The operation of this package is inspired by the R-package recipes. This package allows the user to apply a number of extensible operations for imputation, feature generation/extraction, scaling, and encoding. It operates on modified Dataframe objects from the established data science package Pandas.

Installation

You can install ReciPys from pip using:

pip install recipies

Note that the package is called recipies and not recipys on pip due to a name clash with an existing package.

You can install ReciPys from source to ensure you have the latest version:

conda env update -f environment.yml
conda activate recipys
pip install -e .

Note that the last command installs the package called recipies.

Usage

To define preprocessing operations, one has to supply roles to the different columns of the Dataframe. This allows the user to create groups of columns which have a particular function. Then, we provide several "steps" that can be applied to the datasets, among which: Historical accumulation, Resampling the time resolution, A number of imputation methods, and a wrapper for any Scikit-learn preprocessing step. We believe to have covered any basic preprocessing needs for prepared datasets. Any missing step can be added by following the step interface.

📄Paper

If you use this code in your research, please cite the following publication:

@article{vandewaterYetAnotherICUBenchmark2023,
	title = {Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML},
	shorttitle = {Yet Another ICU Benchmark},
	url = {http://arxiv.org/abs/2306.05109},
	language = {en},
	urldate = {2023-06-09},
	publisher = {arXiv},
	author = {van de Water, Robin and Schmidt, Hendrik and Elbers, Paul and Thoral, Patrick and Arnrich, Bert and Rockenschaub, Patrick},
	month = jun,
	year = {2023},
	note = {arXiv:2306.05109 [cs]},
	keywords = {Computer Science - Machine Learning},
}

This paper can also be found on arxiv: https://arxiv.org/pdf/2306.05109.pdf