Adaptive PCA with parallel scaling and dimensionality reduction
Project description
AdaptivePCA
AdaptivePCA is a Python package designed for high-performance Principal Component Analysis (PCA) with an adaptive component selection approach. It allows the user to perform dimensionality reduction on large datasets efficiently, choosing the optimal number of PCA components based on a specified explained variance threshold. It supports both StandardScaler and MinMaxScaler for data preprocessing and can operate in both parallel and non-parallel modes.
Features
- Automatic Component Selection: Automatically chooses the number of components needed to reach a specified variance threshold.
- Scaler Options: Supports StandardScaler and MinMaxScaler for data scaling.
- Parallel Processing: Uses parallel processing to speed up computations, particularly beneficial for large datasets.
- Easy Integration: Designed to integrate seamlessly with other data science workflows.
Installation
Clone this repository and install the package using pip
:
git clone https://github.com/yourusername/adaptivepca.git
cd adaptivepca
pip install .
Usage
import pandas as pd
from adaptivepca import AdaptivePCA
# Load your data (example)
data = pd.read_csv("your_dataset.csv")
X = data.drop(columns=['Label']) # Features
y = data['Label'] # Target variable
# Initialize and fit AdaptivePCA
adaptive_pca = AdaptivePCA(variance_threshold=0.95, max_components=10)
X_reduced = adaptive_pca.fit_transform(X)
# Results
print("Optimal Components:", adaptive_pca.best_n_components)
print("Explained Variance:", adaptive_pca.best_explained_variance)
Parameters
-
variance_threshold
: float, default=0.95
The cumulative variance explained threshold to determine the optimal number of components. -
max_components
: int, default=10
The maximum number of components to consider.
Methods
fit(X)
: Fits the AdaptivePCA model to the dataX
.transform(X)
: Transforms the dataX
using the fitted PCA model.fit_transform(X)
: Fits and transforms the data in one step.
Example
Below is an example usage of AdaptivePCA in parallel mode:
adaptive_pca = AdaptivePCA(variance_threshold=0.95, max_components=10)
X_reduced = adaptive_pca.fit_transform(X)
print(f"Optimal scaler: {adaptive_pca.best_scaler}")
print(f"Number of components: {adaptive_pca.best_n_components}")
print(f"Explained variance: {adaptive_pca.best_explained_variance}")
License
This project is licensed under the MIT License - see the LICENSE file for details.
Contributing
Contributions are welcome! Please open an issue or submit a pull request to discuss your changes.
Acknowledgments
This project makes use of the scikit-learn
, numpy
, and pandas
libraries for data processing and machine learning.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for adaptivepca-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72e60cf01702d686ff9ca5f6125ad0da4ce93e14b3318e73248e746ee87a3221 |
|
MD5 | 7fe788274e9e66e19d49f344ba1e2c2a |
|
BLAKE2b-256 | f9164e24aaff007311cbc14126e7e343ab9af277331a67b7322dcb6aea0ab6ec |