Feature selection for Hard Voting classifier
Project description
binsel
Feature selection for Hard Voting classifier.
Table of Contents
Installation
The binsel
git repo is available as PyPi package
pip install binsel
Usage
Check the binsel_hardvote
example folder for notebooks.
Algorithm
The task is to select e.g. n_select=3
binary features from a pool of many binary features.
These binary features might be the prediction of binary classifiers.
The selected binary features are then combined into one hard-voting classifier.
A voting classifier should have the following properties
- each voter (a binary feature) should be highly correlated to the target variable
- the selected binary features should be uncorrelated.
The algorithm works as follows
- Generate multiple correlation matrices by bootstrapping (see
korr.bootcorr
). This includescorr(X_i, X_j)
as well ascorr(Y, X_i)
computation. Also store the oob samples for evaluation. - For each correlation matrix do ...
a. Preselect the
i*
with the highestabs(corr(Y, X_i))
estimates (e.g. pick then_pre=?
highest absolute correlations) b. Slice a correlation matrixcorr(X_i*, X_j*)
and find the least correlated combination ofn_select=?
features. (seekorr.mincorr
) c. Compute the out-of-bag (OOB) performance (see step 1) of the hard-voter with the selectedn_select=?
binary features - Select the binary feature combination with the best OOB performance as final model.
Commands
- Check syntax:
flake8 --ignore=F401
- Run Unit Tests:
python -W ignore -m unittest discover
- Remove
.pyc
files:find . -type f -name "*.pyc" | xargs rm
- Remove
__pycache__
folders:find . -type d -name "__pycache__" | xargs rm -rf
- Upload to PyPi with twine:
python setup.py sdist && twine upload -r pypi dist/*
Support
Please open an issue for support.
Contributing
Please contribute using Github Flow. Create a branch, add commits, and open a pull request.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.