PyImpetus is a feature selection algorithm which considers features both separately and together as a group in order to provide not just the best set of features but also the best combination of features
Project description
ChooseWisely
A python library for repurposing traditional classification-based resampling (undersampling and/or oversampling) techniques for regression tasks. Currently supports all resampling techniques present in imblearn
Why does this exist?
While we were working on a regression task, we realized that the target variable was skewed, i.e., most samples were present in a particular range. One can easily solve the skew problem for classification tasks via a slew of resampling techniques (either under or over sampling) but this luxury is unavailable for regression tasks. We therefore decided to create an interface that can repurpose all resampling techniques for classification problems to regression problems!
How to install?
pip install reg_resampler
Functions and parameters
# This returns a numpy list of classes for each corresponding sample. It also automatically merges classes when required
fit(X, target, bins=3, min_n_samples=6, balanced_binning=False, verbose=2)
- X - Either a pandas dataframe or numpy matrix. Complete data to be resampled.
- target - Either string (for pandas) or index (for numpy). The target variable to be resampled.
- bins=3 - The number of classes that the user wants to generate. (Default: 3)
- min_n_samples=6 - Minimum number of samples in each bin. Bins having less than this value will be merged with the closest bin. Has to be more than neighbours in imblearn. (Default: 6)
- balanced_binning=False - Decides whether samples are to be distributed roughly equally across all classes. (Default: False)
- verbose=2 - 0 will disable print by package, 1 will print info about class mergers and 2 will also print class distributions.
# Performs resampling and returns the resampled dataframe/numpy matrices in the form of data and target variable.
resample(sampler_obj, trainX, trainY)
- sampler_obj - Your favourite resampling algorithm's object (currently supports imblearn)
- trainX - Either a pandas dataframe or numpy matrix. Data to be resampled. Also, contains the target variable
- trainY - Numpy array of psuedo classes obtained from fit function.
Important Note
All functions return the same data type as provided in input.
How to import?
from reg_resampler import resampler
Usage
# Initialize the resampler object
rs = resampler()
# You might recieve info about class merger for low sample classes
# Generate classes
Y_classes = rs.fit(df_train, target=target, bins=num_bins)
# Create the actual target variable
Y = df_train[target]
# Create a smote (over-sampling) object from imblearn
smote = SMOTE(random_state=27)
# Now resample
final_X, final_Y = rs.resample(smote, df_train, Y_classes)
Tutorials
You can find further tutorials on how to use this library for cross-validation
Future Ideas
- Support for more resampling techniques
Feature Request
Drop us an email at atif.hit.hassan@gmail.com if you want any particular feature
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for PyImpetus-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c039eb6fa5f19456bbe1a1cda932e2a40f12c71f2eeed6af8dc590940064ce19 |
|
MD5 | b294cc7adea57eb52877fb0eef34b8c2 |
|
BLAKE2b-256 | dfb935dbe56965fe4f3ac631460333b0d2d71ea1583643c0ae030dab6619995b |