Skip to main content

GANFS: GAN-based Feature Selection for Machine Learning

Project description

GANFS: GAN-Based Feature Selection

PyPI version Python 3.8+ License: MIT

A Python library for feature selection using Generative Adversarial Networks. GANFS trains a GAN on your data and uses perturbation-based sensitivity analysis on the discriminator to rank and select the most important features.

Installation

Install via PyPI (Recommended):

pip install ganfs

Install from GitHub (Latest Development Version):

pip install git+https://github.com/patelharsh15/GANFS-GAN-based-feature-selection.git

From source:

git clone https://github.com/patelharsh15/GANFS-GAN-based-feature-selection.git
cd GANFS-GAN-based-feature-selection
pip install -e .

Quick Start

from ganfs import GANFS
import pandas as pd

# Load your dataset
df = pd.read_csv("my_data.csv")
X = df.drop("label", axis=1)
y = df["label"]

# Initialize and train GANFS
selector = GANFS(epochs=200, batch_size=4096)
selector.fit(X, y)

# View feature ranking
ranking = selector.get_feature_ranking()
print(ranking)

# Select top 20 features
X_selected = selector.transform(X, k=20)

# Save/load trained models
selector.save("my_ganfs_model")
loaded = GANFS.load("my_ganfs_model")

API Reference

GANFS Class

Constructor Parameters

Parameter Type Default Description
epochs int 500 Number of GAN training epochs
batch_size int 4096 Batch size for GAN training
learning_rate float 0.001 Adam optimizer learning rate
label_smoothing tuple (0.9, 0.1) Label smoothing for (real, fake)
perturbation_mode str 'dynamic' 'dynamic' or 'static' perturbation scaling
perturbation_factors list [0.5, 1.0, 2.0, 5.0, 10.0] Perturbation multipliers
checkpoint_dir str/None None Directory for training checkpoints
verbose bool True Print progress information
random_state int/None None Random seed for reproducibility

Methods

Method Description
fit(X, y) Train GAN and compute feature sensitivities
transform(X, k) Select top-K features from X
fit_transform(X, y, k) Fit and transform in one step
get_feature_ranking() Get DataFrame of features ranked by sensitivity
get_feature_pairs_from_data(X, top_n) Analyze synergistic feature pair interactions
save(path) Save trained model to disk
GANFS.load(path) Load a saved model from disk

Usage with scikit-learn

from ganfs import GANFS
from sklearn.ensemble import RandomForestClassifier
from sklearn.metrics import accuracy_score

# Feature selection
selector = GANFS(epochs=200)
selector.fit(X_train, y_train)
X_train_selected = selector.transform(X_train, k=20)
X_test_selected = selector.transform(X_test, k=20)

# Downstream classification
clf = RandomForestClassifier()
clf.fit(X_train_selected, y_train)
accuracy = accuracy_score(y_test, clf.predict(X_test_selected))
print(f"Accuracy with top-20 GANFS features: {accuracy:.4f}")

How It Works

  1. GAN Training — A Generator-Discriminator pair is trained on the feature data. The Generator learns to produce realistic synthetic samples, while the Discriminator learns to distinguish real from fake.

  2. Sensitivity Analysis — After training, each feature is perturbed (using dynamic perturbation magnitudes scaled to each feature's natural granularity) and the discriminator's response is measured. Features that cause the largest output changes are the most discriminative.

  3. Feature Ranking — Features are ranked by their average sensitivity scores across multiple perturbation levels and directions.

  4. Feature Selection — The top-K features can be selected for downstream tasks (classification, regression, etc.).

Project Structure

├── ganfs/                           # Python package
│   ├── __init__.py                  # Public API
│   ├── ganfs.py                     # Main GANFS class
│   ├── models.py                    # Generator & Discriminator networks
│   ├── sensitivity.py               # Sensitivity analysis functions
│   └── utils.py                     # GPU setup & preprocessing utilities
├── pyproject.toml                   # Package build configuration
├── GAN Algo Final.ipynb             # Original research notebook
├── benchmarking.ipynb               # Benchmarking vs traditional methods
├── training_checkpoints/            # Saved model checkpoints
├── feature_pair_interactions.csv    # Feature interaction results
└── feature_sensitivity_results.csv  # Feature sensitivity results

Dataset Setup (for reproducing research results)

The original research uses the CIC-DDoS2019 dataset. The dataset files are too large (~12 GB) to host on GitHub.

Download Instructions

  1. Visit the CIC-DDoS2019 dataset page
  2. Request access and download the following CSV files:
    • DrDoS_DNS.csv, DrDoS_LDAP.csv, DrDoS_MSSQL.csv, DrDoS_NTP.csv
    • DrDoS_NetBIOS.csv, DrDoS_SNMP.csv, DrDoS_SSDP.csv, DrDoS_UDP.csv
  3. Place all files in a CIC-DDoS2019/ folder at the repository root
  4. Update the base_path in the notebook to "./CIC-DDoS2019/"

Requirements

  • Python 3.8+
  • TensorFlow 2.x (GPU support recommended)
  • NumPy, Pandas, scikit-learn

Acknowledgments

This project uses the CIC-DDoS2019 dataset provided by the Canadian Institute for Cybersecurity, University of New Brunswick.

If you use the dataset, please cite the original authors:

Iman Sharafaldin, Arash Habibi Lashkari, Saqib Hakak, and Ali A. Ghorbani,
"Developing Realistic Distributed Denial of Service (DDoS) Attack Dataset and Taxonomy",
IEEE 53rd International Carnahan Conference on Security Technology, Chennai, India, 2019.

License

MIT License — see LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ganfs-0.1.2.tar.gz (17.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ganfs-0.1.2-py3-none-any.whl (16.9 kB view details)

Uploaded Python 3

File details

Details for the file ganfs-0.1.2.tar.gz.

File metadata

  • Download URL: ganfs-0.1.2.tar.gz
  • Upload date:
  • Size: 17.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.5

File hashes

Hashes for ganfs-0.1.2.tar.gz
Algorithm Hash digest
SHA256 43e5664598e6a2e06158670e5980336518eba23e7df0307e2349bb6d320ed4e1
MD5 118f6e5f2d88acc4eed81cc65668265c
BLAKE2b-256 dde86d82092d14e033d49f8e6d966e36c0b67de90627d28dd9b315cc81fca93a

See more details on using hashes here.

File details

Details for the file ganfs-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: ganfs-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 16.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.5

File hashes

Hashes for ganfs-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 6dd7ebdf16eba5f05683304acd9a7d8da2b4d0a77301c1c370b88578fb35b8aa
MD5 9196a406bccf2ad2ca5c951a9f6158a6
BLAKE2b-256 49aacff567a051ebb724a590cf787e80a5428ae321552fc33147cdce1a7d400b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page