Skip to main content

A comprehensive toolkit for cluster analysis with full pipeline support

Project description

ClusterTK

PyPI version Python 3.8+ License: MIT

A comprehensive Python toolkit for cluster analysis with full pipeline support.

ClusterTK provides a complete, sklearn-style pipeline for clustering: from raw data preprocessing to cluster interpretation and export. Perfect for data analysts who want powerful clustering without writing hundreds of lines of code.

Features

  • 🔄 Complete Pipeline - One-line solution from raw data to insights
  • 📊 Multiple Algorithms - K-Means, GMM, Hierarchical, DBSCAN
  • 🎯 Auto-Optimization - Automatic optimal cluster number selection
  • 🎨 Rich Visualization - Beautiful plots (optional dependency)
  • 📁 Export & Reports - CSV, JSON, HTML reports with embedded plots
  • 💾 Save/Load - Persist and reload fitted pipelines
  • 🔍 Interpretation - Automatic profiling and cluster naming

Quick Start

Installation

# Core functionality
pip install clustertk

# With visualization
pip install clustertk[viz]

Basic Usage

import pandas as pd
from clustertk import ClusterAnalysisPipeline

# Load data
df = pd.read_csv('your_data.csv')

# Create and fit pipeline
pipeline = ClusterAnalysisPipeline(
    handle_missing='median',
    correlation_threshold=0.85,
    n_clusters=None,  # Auto-detect optimal number
    verbose=True
)

pipeline.fit(df, feature_columns=['feature1', 'feature2', 'feature3'])

# Get results
labels = pipeline.labels_
profiles = pipeline.cluster_profiles_
metrics = pipeline.metrics_

print(f"Found {pipeline.n_clusters_} clusters")
print(f"Silhouette score: {metrics['silhouette']:.3f}")

# Export
pipeline.export_results('results.csv')
pipeline.export_report('report.html')

# Visualize (requires clustertk[viz])
pipeline.plot_clusters_2d()
pipeline.plot_cluster_heatmap()

Documentation

Pipeline Workflow

Raw Data → Preprocessing → Feature Selection → Dimensionality Reduction
→ Clustering → Evaluation → Interpretation → Export

Each step is configurable through pipeline parameters or can be run independently.

Key Capabilities

Preprocessing

  • Missing value handling (median/mean/drop)
  • Outlier detection and treatment
  • Automatic scaling (robust/standard/minmax)
  • Skewness transformation

Clustering Algorithms

  • K-Means - Fast, spherical clusters
  • GMM - Probabilistic, elliptical clusters
  • Hierarchical - Dendrograms, hierarchical structure
  • DBSCAN - Density-based, arbitrary shapes
  • HDBSCAN - Advanced density-based, varying densities (v0.8.0+)
  • HDBSCAN - Advanced density-based, varying densities (v0.8.0+)

Evaluation

  • Silhouette score
  • Calinski-Harabasz index
  • Davies-Bouldin index
  • Automatic optimal k selection

Export & Reports

  • CSV export (data + labels)
  • JSON export (metadata + profiles)
  • HTML reports with embedded visualizations
  • Pipeline serialization (save/load)

Examples

Algorithm Comparison

# Compare multiple algorithms automatically
results = pipeline.compare_algorithms(
    X=df,
    feature_columns=['feature1', 'feature2', 'feature3'],
    algorithms=['kmeans', 'gmm', 'hierarchical', 'dbscan'],
    n_clusters_range=(2, 8)
)

print(results['comparison'])  # DataFrame with metrics
print(f"Best algorithm: {results['best_algorithm']}")

# Visualize comparison
pipeline.plot_algorithm_comparison(results)

Algorithm Comparison

# Compare multiple algorithms automatically
results = pipeline.compare_algorithms(
    X=df,
    feature_columns=['feature1', 'feature2', 'feature3'],
    algorithms=['kmeans', 'gmm', 'hierarchical', 'dbscan'],
    n_clusters_range=(2, 8)
)

print(results['comparison'])  # DataFrame with metrics
print(f"Best algorithm: {results['best_algorithm']}")

# Visualize comparison
pipeline.plot_algorithm_comparison(results)

Customer Segmentation

pipeline = ClusterAnalysisPipeline(
    n_clusters=None,  # Auto-detect
    auto_name_clusters=True
)

pipeline.fit(customers_df,
            feature_columns=['age', 'income', 'purchases'],
            category_mapping={
                'demographics': ['age', 'income'],
                'behavior': ['purchases']
            })

pipeline.export_report('customer_segments.html')

Anomaly Detection

pipeline = ClusterAnalysisPipeline(
    clustering_algorithm='dbscan'
)

pipeline.fit(transactions_df)
anomalies = transactions_df[pipeline.labels_ == -1]

More examples: docs/examples.md

Requirements

  • Python 3.8+
  • numpy >= 1.20.0
  • pandas >= 1.3.0
  • scikit-learn >= 1.0.0
  • scipy >= 1.7.0
  • joblib >= 1.0.0

Optional (for visualization):

  • matplotlib >= 3.4.0
  • seaborn >= 0.11.0

Contributing

Contributions are welcome! Please check:

License

MIT License - see LICENSE file for details.

Citation

If you use ClusterTK in your research, please cite:

@software{clustertk2024,
  author = {Veselov, Aleksey},
  title = {ClusterTK: A Comprehensive Python Toolkit for Cluster Analysis},
  year = {2024},
  url = {https://github.com/alexeiveselov92/clustertk}
}

Links


Made with ❤️ for the data science community

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

clustertk-0.8.0.tar.gz (109.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

clustertk-0.8.0-py3-none-any.whl (81.5 kB view details)

Uploaded Python 3

File details

Details for the file clustertk-0.8.0.tar.gz.

File metadata

  • Download URL: clustertk-0.8.0.tar.gz
  • Upload date:
  • Size: 109.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for clustertk-0.8.0.tar.gz
Algorithm Hash digest
SHA256 f380b0c939e4802e8ab73bc9926a7dd6d49b0226bedc6efa4208f5677655287f
MD5 8b33cdae11f1efdde82f6faddc7b6914
BLAKE2b-256 dd9b708193ab0af5cf460866471214b19d313b9c36804e71bc645bb1791695e2

See more details on using hashes here.

File details

Details for the file clustertk-0.8.0-py3-none-any.whl.

File metadata

  • Download URL: clustertk-0.8.0-py3-none-any.whl
  • Upload date:
  • Size: 81.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for clustertk-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 13a176c8b0e48e2ae6f170f2062896d45631f97a09cd2d102aeb80de00499b11
MD5 718908e58b5dcbae8068841d1a01c88f
BLAKE2b-256 08d83c8a967af2d90cbcd3b102a7ed60817c2c94cdd350ae342bc629324ee050

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page