Skip to main content

KD-AR Stream: Real-Time Data Stream Clustering with Adaptive Radius

Project description

PyPI version License: MIT Python 3.7+

KD-AR Stream

KD-AR Stream is a Python package for real-time data stream clustering using Kd-tree and adaptive radius based methods.

Features

  • Adaptive clustering in streaming data
  • Cluster merging and splitting
  • Supports amount-based and time-based sliding windows
  • Minimal modern plotting for visualization

Installation

pip install kd-ar-stream

Parameters

If you want to use amount-based sliding window assign WindowType.AMOUNT_BASED If you want to use time based sliding window, assign WindowType.TIME_BASED N: int -> Minimum number of points to form a cluster r: float -> Initial cluster radius r_threshold: float -> Radius increase/decrease threshold r_max: float -> Maximum cluster radius window_type: WindowType -> {WindowType.AMOUNT_BASED,WindowType.TIME_BASED window_size: int -> For amount-based: number of points in window verbose: bool {True, False}

Usage

import numpy as np
from sklearn.metrics.cluster import adjusted_rand_score
from sklearn.preprocessing import MinMaxScaler
from kd_ar_stream import KDARStream, KDARStreamConfig, WindowType, load_exclastar

# Load data 
X, y_true = load_exclastar()

# Normalize
scaler = MinMaxScaler()
X_scaled = scaler.fit_transform(X)
np.random.seed(42)

#Parameters N, r, r_threshold, r_max, and window_size are parameters of KD-AR Stream
#If you want to use amount-based sliding window assign WindowType.AMOUNT_BASED
#If you want to use time based sliding window, assign WindowType.TIME_BASED
config = KDARStreamConfig(
	N=22,
	r=0.11,
	r_threshold=0.16,
	r_max=0.43,
	window_size=200,
	window_type=WindowType.AMOUNT_BASED,
	verbose=False
)

kdar = KDARStream(config)
timestamps = np.linspace(0, 10, len(X_scaled))

for i in range(len(X_scaled)):
	kdar.partial_fit(X_scaled[i:i+1], timestamps[i], np.array([i]))
	# Calculate ARI in each 10 points
	if i % 10 == 0 and i > 0:
		kdar.plot_data()
            
# Final ARI
y_pred = kdar.labels_
ARI = adjusted_rand_score(y_true, y_pred)
print(f"Final ARI: {ARI:.4f}")

# Final plot
kdar.plot_data()


## Citation

If you use this algorithm in research, please cite the corresponding paper.


Şenol, A., & Karacan, H. (2020). Kd-tree and adaptive radius (KD-AR Stream) based real-time data stream clustering. Journal of the Faculty of Engineering and Architecture of Gazi University, 35(1).


## BibTeX

@article{senol2020kd,

  title={Kd-tree and adaptive radius (KD-AR Stream) based real-time data stream clustering},
  
  author={Şenol, Ali and Karacan, Hacer},
  
  journal={Journal of the Faculty of Engineering and Architecture of Gazi University},
  
  volume={35},
  
  number={1},
  
  year={2020}
  
}


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kd_ar_stream-1.0.6.tar.gz (18.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kd_ar_stream-1.0.6-py3-none-any.whl (17.0 kB view details)

Uploaded Python 3

File details

Details for the file kd_ar_stream-1.0.6.tar.gz.

File metadata

  • Download URL: kd_ar_stream-1.0.6.tar.gz
  • Upload date:
  • Size: 18.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for kd_ar_stream-1.0.6.tar.gz
Algorithm Hash digest
SHA256 aa1d9db7f1f19ebbdf3144469b962bbd55e9c4b72af38885f0e6e8e51a94b3c2
MD5 8ca4908f9fb5eccd9709d5af26a0a83f
BLAKE2b-256 2848385db653ffcc95f4cfe72e6c6a5be406089dd1b26a514971f5427b8768ca

See more details on using hashes here.

File details

Details for the file kd_ar_stream-1.0.6-py3-none-any.whl.

File metadata

  • Download URL: kd_ar_stream-1.0.6-py3-none-any.whl
  • Upload date:
  • Size: 17.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for kd_ar_stream-1.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 87a3914a23ccb9bb5f6b4a000c32914584871aa0adc49eb97f04247b2bb914ee
MD5 6078e4a1c959e2ed28e7d34afc3d82c2
BLAKE2b-256 d79675264693e9851014df1d2427822078e58f6ab35093bd754a0447038fc24f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page