Skip to main content

Modular and extensible data preprocessing library

Project description

๐Ÿชฟ๐Ÿชฟ GeeseTools ๐Ÿ› ๏ธ๐Ÿ› ๏ธ

Modular and Extensible Data Preprocessing Library for Machine Learning

GeeseTools is a plug-and-play, mixin-based Python library that streamlines the preprocessing of tabular datasets for machine learning tasks. Whether youโ€™re cleaning messy data, encoding categories, transforming skewed distributions, or scaling features โ€” this package has you covered.


๐Ÿš€ Features

  • ๐Ÿงผ Handle missing data
  • ๐Ÿ”ข Convert object columns to numeric
  • ๐Ÿ” Identify feature types (categorical, ordinal, nominal, etc.)
  • โš™๏ธ Encode nominal and ordinal features
  • ๐Ÿ”„ Transform skewed and heavy-tailed features
  • ๐Ÿ“ Scale features with standard or power transformations
  • ๐Ÿงช Train-test split with optional oversampling
  • ๐Ÿ“Š Transformation logs for transparency and reproducibility
  • ๐Ÿ”Œ Built using Mixins for modular extension

โš™๏ธ Installation

You can install the package directly from PyPI:

pip install GeeseTools

Or, after building your wheel file (.whl) from the source:

pip install dist/GeeseTools-0.1.8-py3-none-any.whl

Or install directly in editable mode (for development):

pip install -e .

๐Ÿงช Usage

import GeeseTools as gt

# Instantiate with a dataset
obj = gt(
    dataframe=df,
    target_variable='target',
    ordinal_features=['education_level'],
    ordinal_categories=[['Low', 'Medium', 'High']],
    use_one_hot_encoding=True
)

# Apply full preprocessing pipeline
X_train, X_test, y_train, y_test = obj.pre_process()

# Access logs
print(obj.transformation_log_df)

๐Ÿ—‚ Default Sample Dataset

If no DataFrame is provided, the processor loads a built-in heart.csv dataset:

obj = GeeseTools()  # Uses sample heart dataset

# Apply full preprocessing pipeline
X_train, X_test, y_train, y_test = obj.pre_process()

๐Ÿ“ Project Structure

๐Ÿ“ฆ GeeseTools/
โ”œโ”€โ”€ ๐Ÿ“‚ data/                            # ๐Ÿ“ Contains bundled datasets
โ”‚   โ”œโ”€โ”€ ๐Ÿ“„ heart.csv                    # ๐Ÿ“Š Sample dataset (CSV format)
โ”‚   โ””โ”€โ”€ ๐Ÿ“œ __init__.py                  # ๐Ÿ“ฆ Makes 'data' a subpackage
โ”‚
โ”œโ”€โ”€ ๐Ÿ“œ GeeseTools.py                    # ๐Ÿง  Core toolkit initializer or controller
โ”œโ”€โ”€ ๐Ÿ“œ datasets.py                      # ๐Ÿ“‚ Dataset loading utilities
โ”œโ”€โ”€ ๐Ÿงฉ display_mixin.py                 # ๐Ÿ–ฅ๏ธ Display-related mixin
โ”œโ”€โ”€ ๐Ÿงฉ drop_features_mixin.py           # โœ‚๏ธ Drop unwanted features
โ”œโ”€โ”€ ๐Ÿงฉ drop_records_mixin.py            # ๐Ÿ—‘๏ธ Drop records based on rules
โ”œโ”€โ”€ ๐Ÿงฉ encode_mixin.py                  # ๐Ÿ”ค Encoding (label, one-hot)
โ”œโ”€โ”€ ๐Ÿงฉ feature_target_split_mixin.py    # ๐Ÿ”€ Split into features & target
โ”œโ”€โ”€ ๐Ÿงฉ feature_type_mixin.py            # ๐Ÿงฌ Feature type detection
โ”œโ”€โ”€ ๐Ÿงฉ impute_features_mixin.py         # ๐Ÿฉน Fill missing values
โ”œโ”€โ”€ ๐Ÿงฉ missing_data_summary_mixin.py    # ๐Ÿ“‰ Summary of missing data
โ”œโ”€โ”€ ๐Ÿงฉ oversample_mixin.py              # ๐Ÿงช Oversampling (e.g., SMOTE)
โ”œโ”€โ”€ ๐Ÿงฉ pre_process_mixin.py             # โš™๏ธ Complete preprocessing pipeline
โ”œโ”€โ”€ ๐Ÿงฉ sample_data_mixin.py             # ๐ŸŽฒ Random sampling utilities
โ”œโ”€โ”€ ๐Ÿงฉ scale_mixin.py                   # ๐Ÿ“ Scaling methods
โ”œโ”€โ”€ ๐Ÿงฉ split_dataframe_mixin.py         # ๐Ÿงฏ Split dataframe columns
โ”œโ”€โ”€ ๐Ÿงฉ to_numeric_mixin.py              # ๐Ÿ”ข Convert to numeric
โ”œโ”€โ”€ ๐Ÿงฉ transform_mixin.py               # ๐Ÿ”ง Feature transformations
โ”œโ”€โ”€ ๐Ÿงฉ unique_value_summary_mixin.py    # ๐Ÿงพ Unique value summary
โ””โ”€โ”€ ๐Ÿ“œ __init__.py                      # ๐Ÿ“ฆ Initializes GeeseTools package

โš™๏ธ Requirements

  • Python 3.9โ€“3.11
  • pandas
  • scikit-learn
  • imbalanced-learn
  • scipy
  • ipython
  • openpyxl

๐Ÿ“œ License

MIT ยฉ Abhijeet
You're free to use, modify, and distribute this project with proper attribution.


โœจ Contributions Welcome

Want to add new mixins or support more file types? Fork it, branch it, push it, and letโ€™s build together!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

geesetools-0.1.13.tar.gz (28.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

geesetools-0.1.13-py3-none-any.whl (33.1 kB view details)

Uploaded Python 3

File details

Details for the file geesetools-0.1.13.tar.gz.

File metadata

  • Download URL: geesetools-0.1.13.tar.gz
  • Upload date:
  • Size: 28.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.11

File hashes

Hashes for geesetools-0.1.13.tar.gz
Algorithm Hash digest
SHA256 790688416553cde741bb666e5aa8dff3a7f7e461adfe14893118a53cf63326af
MD5 b31b9049b873b7fc0d3a8ecfa587c688
BLAKE2b-256 f3d360a23812df54135fda58ccd1f043510368922d83dd3cd6b266eb4a1e0aa9

See more details on using hashes here.

File details

Details for the file geesetools-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: geesetools-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 33.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.11

File hashes

Hashes for geesetools-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 d18c3e812de9551e8f2868d7e273840ad87e8f1435618ed207f2999b8a628104
MD5 6adaf268558564955eaef423c8d505ae
BLAKE2b-256 2655a5b3e26ba8aecc72f79c0efcfe9c45fc32c0c817687d2e4c74f76019df26

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page