Skip to main content

KD-AR Stream: Real-Time Data Stream Clustering with Adaptive Radius

Project description

PyPI version License: MIT Python 3.7+

KD-AR Stream

KD-AR Stream is a Python package for real-time data stream clustering using Kd-tree and adaptive radius based methods.

Features

  • Adaptive clustering in streaming data
  • Cluster merging and splitting
  • Supports amount-based and time-based sliding windows
  • Minimal modern plotting for visualization

Installation

pip install kd-ar-stream

Usage

from kd_ar_stream import KDARStream, KDARStreamConfig, WindowType, load_exclastar

X, y_true = load_exclastar()

config = KDARStreamConfig(N=22, r=0.11, r_threshold=0.16, r_max=0.43)
kdar = KDARStream(config)

for i in range(len(X)):
    kdar.partial_fit(X[i:i+1])

Advanced Usage

import unittest
import numpy as np
from sklearn.metrics.cluster import adjusted_rand_score
from sklearn.preprocessing import MinMaxScaler
import matplotlib.pyplot as plt
from kd_ar_stream import KDARStream, KDARStreamConfig, WindowType, load_exclastar

# Load data 
X, y = load_exclastar()

# Normalize
scaler = MinMaxScaler()
X_scaled = scaler.fit_transform(X)
np.random.seed(42)

#Parameters N, r, r_threshold, r_max, and window_size are parameters of KD-AR Stream
#If you want to use amount-based sliding window assign WindowType.AMOUNT_BASED
#If you want to use time based sliding window, assign WindowType.TIME_BASED
config = KDARStreamConfig(
	N=22,
	r=0.11,
	r_threshold=0.16,
	r_max=0.43,
	window_size=200,
	window_type=WindowType.AMOUNT_BASED,
	verbose=False
)

kdar = KDARStream(config)
timestamps = np.linspace(0, 10, len(X_scaled))

ARI_history = []
for i in range(len(X_scaled)):
	kdar.partial_fit(X_scaled[i:i+1], timestamps[i], np.array([i]))
	
	# CAlculate ARI in each 10 points
	if i % 10 == 0 and i > 0:
		current_labels = kdar.labels_[:i+1]
		if len(np.unique(current_labels[current_labels != -1])) > 1:
			ARI = adjusted_rand_score(y_true[:i+1], current_labels)
			ARI_history.append(ARI)
			kdar.plot_data("Current ARI", ARI)


# Final ARI
y_pred = kdar.labels_
ARI = adjusted_rand_score(y_true, y_pred)
print(f"Final ARI: {ARI:.4f}")

# Final plot
kdar.plot_data("Final ARI", ARI)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kd_ar_stream-1.0.0.tar.gz (18.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kd_ar_stream-1.0.0-py3-none-any.whl (16.7 kB view details)

Uploaded Python 3

File details

Details for the file kd_ar_stream-1.0.0.tar.gz.

File metadata

  • Download URL: kd_ar_stream-1.0.0.tar.gz
  • Upload date:
  • Size: 18.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for kd_ar_stream-1.0.0.tar.gz
Algorithm Hash digest
SHA256 91b21e1d4fc6952c45d76bee39b05decc6a2e5c75463788e12d5a031de1ea0e8
MD5 58d0295010ac36e0449268d264677546
BLAKE2b-256 7275e5e687fe4c4008bbf1d1f794d63fe2cde5e4a64a7ca2a3453fbbc1506c9f

See more details on using hashes here.

File details

Details for the file kd_ar_stream-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: kd_ar_stream-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 16.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for kd_ar_stream-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2aa96fc5990830dc7af0b3601c48e81b3dac64998df2b7dda5bad2cd3cd01d46
MD5 5b1c10dd3648d7861746bb9e4b5fa167
BLAKE2b-256 0ffb657e63243679a1b1e6d2f9f32eb017c092fee62713b43808f2ed151fcbd7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page