Skip to main content

A modular preprocessing package for Pandas Dataframe

Project description

logo

🥧ReciPys🐍

CI Black Platform License PyPI version shields.io arXiv

The ReciPys package is a preprocessing framework operating on Pandas dataframes. The operation of this package is inspired by the R-package recipes. This package allows the user to apply a number of extensible operations for imputation, feature generation/extraction, scaling, and encoding. It operates on modified Dataframe objects from the established data science package Pandas.

Installation

You can install ReciPys from pip using:

pip install recipies

Note that the package is called recipies and not recipys on pip due to a name clash with an existing package.

You can install ReciPys from source to ensure you have the latest version:

conda env update -f environment.yml
conda activate recipys
pip install -e .

Note that the last command installs the package called recipies.

Usage

To define preprocessing operations, one has to supply roles to the different columns of the Dataframe. This allows the user to create groups of columns which have a particular function. Then, we provide several "steps" that can be applied to the datasets, among which: Historical accumulation, Resampling the time resolution, A number of imputation methods, and a wrapper for any Scikit-learn preprocessing step. We believe to have covered any basic preprocessing needs for prepared datasets. Any missing step can be added by following the step interface.

📄Paper

If you use this code in your research, please cite the following publication:

@article{vandewaterYetAnotherICUBenchmark2023,
	title = {Yet Another ICU Benchmark: A Flexible Multi-Center Framework for Clinical ML},
	shorttitle = {Yet Another ICU Benchmark},
	url = {http://arxiv.org/abs/2306.05109},
	language = {en},
	urldate = {2023-06-09},
	publisher = {arXiv},
	author = {van de Water, Robin and Schmidt, Hendrik and Elbers, Paul and Thoral, Patrick and Arnrich, Bert and Rockenschaub, Patrick},
	month = jun,
	year = {2023},
	note = {arXiv:2306.05109 [cs]},
	keywords = {Computer Science - Machine Learning},
}

This paper can also be found on arxiv: https://arxiv.org/pdf/2306.05109.pdf

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

recipies-1.0rc1.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

recipies-1.0rc1-py3-none-any.whl (14.4 kB view details)

Uploaded Python 3

File details

Details for the file recipies-1.0rc1.tar.gz.

File metadata

  • Download URL: recipies-1.0rc1.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.14

File hashes

Hashes for recipies-1.0rc1.tar.gz
Algorithm Hash digest
SHA256 784511f8bf68c07ef089614a740aba7d9e359d44adcada6837570a8cc4b0912e
MD5 6006461c4eed38e0b9c17d30f36a56c8
BLAKE2b-256 e21f65b38e440f4b42312ab22845f57229fec789ecc867a97649d54ba0b6aeb9

See more details on using hashes here.

File details

Details for the file recipies-1.0rc1-py3-none-any.whl.

File metadata

  • Download URL: recipies-1.0rc1-py3-none-any.whl
  • Upload date:
  • Size: 14.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.14

File hashes

Hashes for recipies-1.0rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 55566f4a763f5805a4adec564a218e907ff66e9f10b501645b9609698b36b7c6
MD5 cdc920b8016061d22e351ec8e55da692
BLAKE2b-256 f0d0e0a402cb41ff3bdde689b8076c56fab9869b26a91d58334faaff461bca1a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page