Skip to main content

A Python implementation of the Directed Batch Growing Self-Organizing Map

Project description

license readthedocs DOI Python package Publish to PyPI CodeQL Advanced Ruff

DBGSOM

DBGSOM is short for Directed Batch Growing Self-Organizing Map. A SOM is a type of artificial neural network that is used to produce a low-dimensional representation of a higher-dimensional data set while preserving the topological structure of the data. It can be used for supervised and unsupervised vector quantization, classification and many different data visualization tasks.

Features

  • Compatible with scikit-learn's API — drop-in replacement for other clustering and classification algorithms
  • Can handle high-dimensional and non-uniform data distributions
  • Good results without extensive parameter tuning
  • Better topology preservation and faster training time than classical SOMs
  • Interpretability of the results through interactive plotting

How it works

The DBGSOM algorithm builds a two-dimensional map of prototypes (neurons) where each neuron is connected to its neighbors. Four neurons are initialized with random weight vectors drawn from the input data. During training every sample is assigned to its nearest neuron (best matching unit), and the neuron weights are updated towards the samples mapped to them. Neighboring neurons influence each other's updates so that the low-dimensional ordering of the map is preserved. A growing mechanism expands the map as needed: new neurons are inserted at boundary positions where the quantization error exceeds a configurable growing threshold.

How to install

Download from PyPI

DBGSOM can be installed from PyPI via uv (recommended):

uv add dbgsom

or with pip:

pip install dbgsom

Install from source

Clone the repository and install with uv (recommended):

git clone https://github.com/SandroMartens/DBGSOM.git
cd DBGSOM
uv sync

Alternatively with pip:

git clone https://github.com/SandroMartens/DBGSOM.git
cd DBGSOM
pip install -e .

Usage

DBGSOM implements the scikit-learn API and provides two estimators:

Class Use case
SomVQ Unsupervised clustering / vector quantization
SomClassifier Supervised classification

Clustering / Vector Quantization

from dbgsom import SomVQ
from sklearn.datasets import load_digits

X, y = load_digits(return_X_y=True)

vq = SomVQ(spreading_factor=0.5, max_neurons=80)
labels = vq.fit_predict(X)

print(f"Neurons: {len(vq.neurons_)}")
print(f"Quantization error: {vq.quantization_error_:.4f}")
print(f"Topographic error:  {vq.topographic_error_:.4f}")

Classification

from dbgsom import SomClassifier
from sklearn.datasets import load_digits
from sklearn.model_selection import train_test_split

X, y = load_digits(return_X_y=True)
X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=42)

clf = SomClassifier(spreading_factor=0.5, max_neurons=80)
clf.fit(X_train, y_train)

print(clf.score(X_test, y_test))           # accuracy
proba = clf.predict_proba(X_test)          # class probabilities

Transform

Both estimators implement transform(), which represents each sample as a sparse non-negative linear combination of the prototype weight vectors:

coefs = vq.transform(X)   # shape (n_samples, n_prototypes)

Visualization

plot() renders the SOM neurons as dots and the neighbourhood edges as grey lines, all via seaborn objects.

vq.plot(color="density")                       # continuous → colour gradient
clf.plot(color="label")                        # categorical → colour legend
vq.plot(color="hit_count", pointsize="error")  # colour + size encoding
vq.plot(color="density", layout="pca", palette="magma_r")
vq.plot(color="pca_rgb")                       # RGB colour from PCA of weight vectors

Supported attributes for color / pointsize: 'label', 'epoch_created', 'error', 'average_distance', 'density', 'hit_count'

Parameter Options Description
color any node attribute Numeric attributes → continuous colour scale; int/str with ≤ 20 unique values → legend
pointsize any numeric attribute Node size proportional to attribute value
layout 'grid' (default), 'pca' Node placement algorithm
palette any Matplotlib colormap Applied to the colour mapping

Examples

Example Description
example With two-dimensional input we can clearly see how the prototypes (red) approximate the input distribution (white) while preserving the square topology to their neighbors.
The fashion mnist dataset After training on the Fashion-MNIST dataset we can plot the weigth of each prototype. Neighboring prototypes are pairwise similar.
digits Each prototype is coloured by its majority class. Samples from the same class cluster together. Trained on MNIST digits.
darknet_pca Linear transformations like PCA can colour-code relative distances between prototypes in the input space. See the darknet example notebook.

Dependencies

  • Python ≥ 3.12
  • numpy
  • numba
  • NetworkX
  • tqdm
  • scikit-learn
  • seaborn
  • pandas

Citation

If you use DBGSOM in your research, please cite:

Martens, S. (2025). DBGSOM: A Python implementation of the Directed Batch Growing Self-Organizing Map. Zenodo. https://doi.org/10.5281/zenodo.20525611

References

  • A directed batch growing approach to enhance the topology preservation of self-organizing map, Mahdi Vasighi and Homa Amini, 2017, http://dx.doi.org/10.1016/j.asoc.2017.02.015
  • Reference implementation by the authors in Matlab: https://github.com/mvasighi/DBGSOM
  • Statistics-enhanced Direct Batch Growth Self-Organizing Mapping for efficient DoS Attack Detection, Xiaofei Qu et al., 2019, 10.1109/ACCESS.2019.2922737
  • Entropy-Defined Direct Batch Growing Hierarchical Self-Organizing Mapping for Efficient Network Anomaly Detection, Xiaofei Qu et al., 2021, 10.1109/ACCESS.2021.3064200
  • Self-Organizing Maps, 3rd Edition, Teuvo Kohonen, 2003
  • MATLAB Implementations and Applications of the Self-Organizing Map, Teuvo Kohonen, 2014
  • Smoothed self-organizing map for robust clustering, P. D'Urso, L. De Giovanni and R. Massari, 2019, https://doi.org/10.1016/j.ins.2019.06.038

License

dbgsom is licensed under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbgsom-1.2.4.tar.gz (35.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dbgsom-1.2.4-py3-none-any.whl (27.8 kB view details)

Uploaded Python 3

File details

Details for the file dbgsom-1.2.4.tar.gz.

File metadata

  • Download URL: dbgsom-1.2.4.tar.gz
  • Upload date:
  • Size: 35.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dbgsom-1.2.4.tar.gz
Algorithm Hash digest
SHA256 6f5730ffe2aca332cbe5f173aabba0855906264a3e943b67b4924ee9a4ff2a3d
MD5 cec86de1348fc0ae6751af4c17f7865f
BLAKE2b-256 ee664de84ef31b605d214aec5bad1a4313704502ab80040b405f63107f5b6621

See more details on using hashes here.

File details

Details for the file dbgsom-1.2.4-py3-none-any.whl.

File metadata

  • Download URL: dbgsom-1.2.4-py3-none-any.whl
  • Upload date:
  • Size: 27.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for dbgsom-1.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ee0ce9ae6159694c3d8b42eb9f00def83239aada89108d50a2cfdfe417c53ddd
MD5 d703bda1592a2e655179df5546dac15e
BLAKE2b-256 ba3ae6539ac336cc301600ebc4309a6f0004d81d46f29fefecfc9b516c9d1165

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page