Skip to main content

abess: Fast Best Subset Selection

Project description

logopic

Python build status R build status codecov Documentation Status cran pypi conda-forge pyversions License Codacy CodeFactor Platform Downloads

Overview

abess (Adaptive BEst Subset Selection) library aims to solve general best subset selection, i.e., find a small subset of predictors such that the resulting model is expected to have the highest accuracy. The selection for best subset shows great value in scientific researches and practical application. For example, clinicians wants to know whether a patient is health or not based on the expression level of a few of important genes.

This library implements a generic algorithm framework to find the optimal solution in an extremely fast way [1]. This framework now supports the detection of best subset under: linear regression, (multi-class) classification, censored-response modeling [2], multi-response modeling (a.k.a. multi-tasks learning), etc. It also supports the variants of best subset selection like group best subset selection [3] and nuisance best subset selection [4]. Especially, the time complexity of (group) best subset selection for linear regression is certifiably polynomial [1] [3].

Quick start

Install the stable abess Python package from Pypi:

$ pip install abess

Best subset selection for linear regression on a simulated dataset in Python:

from abess.linear import LinearRegression
from abess.datasets import make_glm_data
sim_dat = make_glm_data(n = 300, p = 1000, k = 10, family = "gaussian")
model = LinearRegression()
model.fit(sim_dat.x, sim_dat.y)

See more examples analyzed with Python in the tutorials; the notebooks are available here.

Runtime Performance

To show the power of abess in computation, we assess its timings of the CPU execution (seconds) on synthetic datasets, and compare to state-of-the-art variable selection methods. The variable selection and estimation results are deferred to performance.

We compare abess Python package with scikit-learn on linear and logistic regression. Results are presented in the below figure, and can be reproduce by running the commands in shell:

$ python ./simulation/Python/timings.py

we obtain the runtime comparison picture:

pic1

abess reaches a high efficient performance especially in linear regression where it gives the fastest solution.

Open source software

abess is a free software and its source code are publicly available in Github. The core framework is programmed in C++, and user-friendly R and Python interfaces are offered. You can redistribute it and/or modify it under the terms of the GPL-v3 License. We welcome contributions for abess, especially stretching abess to the other best subset selection problems.

Citation

If you use abess or reference our tutorials in a presentation or publication, we would appreciate citations of our library [5].

Jin Zhu, Liyuan Hu, Junhao Huang, Kangkang Jiang, Yanhang Zhang, Shiyun Lin, Junxian Zhu, Xueqin Wang (2022). “abess: A Fast Best Subset Selection Library in Python and R.” Journal of Machine Learning Research (Accepted).

The corresponding BibteX entry:

@article{zhu2022abess,
   author  = {Jin Zhu and Liyuan Hu and Junhao Huang and Kangkang Jiang and Yanhang Zhang and Shiyun Lin and Junxian Zhu and Xueqin Wang},
   title   = {abess: A Fast Best Subset Selection Library in Python and R},
   journal = {Journal of Machine Learning Research (Accepted)},
   year    = {2022}
}

References

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abess-0.4.7.tar.gz (1.5 MB view hashes)

Uploaded source

Built Distributions

abess-0.4.7-cp310-cp310-win_amd64.whl (538.6 kB view hashes)

Uploaded cp310

abess-0.4.7-cp310-cp310-win32.whl (490.9 kB view hashes)

Uploaded cp310

abess-0.4.7-cp310-cp310-macosx_11_0_arm64.whl (424.9 kB view hashes)

Uploaded cp310

abess-0.4.7-cp310-cp310-macosx_10_9_x86_64.whl (459.0 kB view hashes)

Uploaded cp310

abess-0.4.7-cp39-cp39-win_amd64.whl (538.6 kB view hashes)

Uploaded cp39

abess-0.4.7-cp39-cp39-win32.whl (491.1 kB view hashes)

Uploaded cp39

abess-0.4.7-cp39-cp39-macosx_11_0_arm64.whl (425.0 kB view hashes)

Uploaded cp39

abess-0.4.7-cp39-cp39-macosx_10_9_x86_64.whl (459.1 kB view hashes)

Uploaded cp39

abess-0.4.7-cp38-cp38-win_amd64.whl (538.4 kB view hashes)

Uploaded cp38

abess-0.4.7-cp38-cp38-win32.whl (490.9 kB view hashes)

Uploaded cp38

abess-0.4.7-cp38-cp38-macosx_11_0_arm64.whl (424.8 kB view hashes)

Uploaded cp38

abess-0.4.7-cp38-cp38-macosx_10_9_x86_64.whl (459.0 kB view hashes)

Uploaded cp38

abess-0.4.7-cp37-cp37m-win_amd64.whl (539.1 kB view hashes)

Uploaded cp37

abess-0.4.7-cp37-cp37m-win32.whl (491.7 kB view hashes)

Uploaded cp37

abess-0.4.7-cp37-cp37m-macosx_10_9_x86_64.whl (459.1 kB view hashes)

Uploaded cp37

abess-0.4.7-cp36-cp36m-win_amd64.whl (539.0 kB view hashes)

Uploaded cp36

abess-0.4.7-cp36-cp36m-win32.whl (491.6 kB view hashes)

Uploaded cp36

abess-0.4.7-cp36-cp36m-macosx_10_9_x86_64.whl (459.1 kB view hashes)

Uploaded cp36

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page