Skip to main content

KD-AR Stream: Real-Time Data Stream Clustering with Adaptive Radius

Project description

PyPI version License: MIT Python 3.7+

KD-AR Stream

KD-AR Stream is a Python package for real-time data stream clustering using Kd-tree and adaptive radius based methods.

Features

  • Adaptive clustering in streaming data
  • Cluster merging and splitting
  • Supports amount-based and time-based sliding windows
  • Minimal modern plotting for visualization

Installation

pip install kd-ar-stream

Parameters

If you want to use amount-based sliding window assign WindowType.AMOUNT_BASED If you want to use time based sliding window, assign WindowType.TIME_BASED N: int -> Minimum number of points to form a cluster r: float -> Initial cluster radius r_threshold: float -> Radius increase/decrease threshold r_max: float -> Maximum cluster radius window_type: WindowType -> {WindowType.AMOUNT_BASED,WindowType.TIME_BASED window_size: int -> For amount-based: number of points in window verbose: bool {True, False}

Usage

import numpy as np
from sklearn.metrics.cluster import adjusted_rand_score
from sklearn.preprocessing import MinMaxScaler
from kd_ar_stream import KDARStream, KDARStreamConfig, WindowType, load_exclastar

# Load data 
X, y_true = load_exclastar()

# Normalize
scaler = MinMaxScaler()
X_scaled = scaler.fit_transform(X)
np.random.seed(42)

#Parameters N, r, r_threshold, r_max, and window_size are parameters of KD-AR Stream
#If you want to use amount-based sliding window assign WindowType.AMOUNT_BASED
#If you want to use time based sliding window, assign WindowType.TIME_BASED
config = KDARStreamConfig(
	N=22,
	r=0.11,
	r_threshold=0.16,
	r_max=0.43,
	window_size=200,
	window_type=WindowType.AMOUNT_BASED,
	verbose=False
)

kdar = KDARStream(config)
timestamps = np.linspace(0, 10, len(X_scaled))

for i in range(len(X_scaled)):
	kdar.partial_fit(X_scaled[i:i+1], timestamps[i], np.array([i]))
	# Calculate ARI in each 10 points
	if i % 10 == 0 and i > 0:
		kdar.plot_data()
            
# Final ARI
y_pred = kdar.labels_
ARI = adjusted_rand_score(y_true, y_pred)
print(f"Final ARI: {ARI:.4f}")

# Final plot
kdar.plot_data()

Citation

If you use this algorithm in research, please cite the corresponding paper.

Şenol, A., & Karacan, H. (2020). Kd-tree and adaptive radius (KD-AR Stream) based real-time data stream clustering. Journal of the Faculty of Engineering and Architecture of Gazi University, 35(1).

BibTeX

@article{senol2020kd,

title={Kd-tree and adaptive radius (KD-AR Stream) based real-time data stream clustering},

author={Şenol, Ali and Karacan, Hacer},

journal={Journal of the Faculty of Engineering and Architecture of Gazi University},

volume={35},

number={1},

year={2020}

}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kd_ar_stream-1.0.7.tar.gz (18.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kd_ar_stream-1.0.7-py3-none-any.whl (17.0 kB view details)

Uploaded Python 3

File details

Details for the file kd_ar_stream-1.0.7.tar.gz.

File metadata

  • Download URL: kd_ar_stream-1.0.7.tar.gz
  • Upload date:
  • Size: 18.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for kd_ar_stream-1.0.7.tar.gz
Algorithm Hash digest
SHA256 ce686e6a83d7d620eb4858a9aadc18c94513a7ad1fc6f78ae6512669b4459ecb
MD5 988755acbb97e2b170ef0f203bd2f2e1
BLAKE2b-256 20bbb86b430848f63ee1bb62cb6c971feed40b8660757885d1a642d79953b545

See more details on using hashes here.

File details

Details for the file kd_ar_stream-1.0.7-py3-none-any.whl.

File metadata

  • Download URL: kd_ar_stream-1.0.7-py3-none-any.whl
  • Upload date:
  • Size: 17.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for kd_ar_stream-1.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 f346dfb645bb880ab117e903f065247e27b2b632a5ff12ef468cfc3f169bb923
MD5 82a4573f812fc13e4b21306c09e0ebe1
BLAKE2b-256 ddd6fdc7f31c4a98c0dc783e9ccd7330d2d7bc898a45e785b42544774735926a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page