Skip to main content

Privacy-Preserving Contextual Edge Video Analytics SDK

Project description

FluxState Edge Hero Banner

🦅 FluxState Edge SDK

Privacy-Preserving Contextual Edge Video Analytics for Enterprise Security

License: MIT Tests: Passing


FluxState Edge is an extensible, camera-agnostic video analytics SDK designed for direct integration into proprietary security backends. It processes RTSP streams locally on the edge, extracting behavioral metadata via object detection, 3D skeletal posing, audio processing, and VLM semantic reasoning with our v1.1 Adaptive Intelligence layer.



🚀 Quick Install

pip install fluxstate-security

🎥 Installation Demo

See the SDK installation and verification in under a minute.

▶️ Watch Installation Demo (Google Drive)


⚡ System Capabilities

Capability Technical Implementation
🧠 Agentic VLM Reasoner Runs Vision-Language Models (e.g., Qwen2.5-VL) locally via MLX on Apple Silicon unified memory for deep contextual scene understanding. Bypasses cloud APIs entirely.
🔄 Adaptive Intelligence (v1.1) Seamlessly loads and unloads MLX models (MLXModelPool) to manage unified memory. Provides a Feedback API to suppress false positives on-device without retraining.
📚 Semantic Retrieval (RAG) Embeds scene telemetry and queries an on-device ContextLedger using cosine similarity to inject historical context into the VLM prompt.
⏱️ Episodic Memory Buffers the last 10 minutes of scene states (EpisodicMemoryBuffer) with O(1) operations, allowing delayed asynchronous operator feedback.
🎯 Tactical Visual Grounding Automatically injects high-contrast red bounding boxes over anomalies. This guides the VLM toward the detected region, reducing irrelevant reasoning and improving contextual grounding.
🛡️ Privacy-by-Design Actively zeroes out image buffers post-inference via C-level memset. Designed with privacy-first principles to prevent sensitive pixel data from lingering in the system heap.
🗄️ Temporal Forensics Behavioral anomalies are serialized into a local SQLite database (fluxstate_security/core/forensics.py), creating a searchable text-based ledger of physical events.
📹 Hardware Agnostic Ingests existing IP cameras via standard RTSP URLs. No proprietary recording hardware required.
🐳 Edge Containerization Ships with a highly optimized Dockerfile for enterprise edge deployments (Kubernetes/Docker Swarm), permanently locking native OS dependencies.

🖼️ Architectural Vision & Use Cases

FluxState Architecture Diagram

System Overview

Sub-Pipelines

Adaptive Pipeline RAG Flow Feedback Loop

Tech Stack

🛠️ Minimal SDK Integration

FluxState is designed to fade into the background. Drop it into your existing backend and attach a webhook.

import time
from fluxstate_security import FluxStateNode

# 1. Initialize the SDK
sdk = FluxStateNode()

# 2. Define your integration hook
def handle_threat(event_payload):
    print(f"\n[INTEGRATION BUS] Escalating to VMS...")
    print(f"Target Identity: {event_payload['entities']}")
    print(f"Behavioral Vector: {event_payload['context_log']}")
    print(f"Feedback Event ID: {event_payload.get('event_id', 'None')}")

# 3. Bind the hook
sdk.on_threat_detected = handle_threat

# 4. Deploy Headlessly (Runs as a background daemon)
sdk.start_headless_daemon()
sdk.start_api_server(port=8000) # Starts the JSON API & Feedback loop

try:
    while True: time.sleep(1)
except KeyboardInterrupt:
    sdk.stop() # 5. Clean shutdown

📦 Deployment Strategies

Option A: Enterprise Docker Deployment (Recommended)
For production environments, use the provided Docker container to guarantee system dependencies (Tesseract, PortAudio) are perfectly locked across the cluster.
docker build -t fluxstate-security .
docker run -d --name fluxstate-security fluxstate-security
Option B: Local Python Development
pip install fluxstate-security

# macOS dependencies
brew install tesseract portaudio

# Linux dependencies
sudo apt-get install tesseract-ocr libportaudio2 libportaudiocpp0 portaudio19-dev

🧪 Forensics & Testing

FluxState ships with an automated pytest suite covering the Forensic SQLite ledger, semantic retrievers, and JSON intelligence policies.

pytest tests/

📡 API Reference

POST /api/v2/feedback

Submit operator feedback to adapt the system. Payload:

{
  "event_id": "uuid-string",
  "human_label": "FALSE_POSITIVE",
  "operator_id": "guard-123",
  "operator_role": "admin"
}

For a deeper dive into the threading model, VLM orchestration, and the SQLite schema, see architecture_adaptive_edge.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fluxstate_security-1.1.0.tar.gz (41.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fluxstate_security-1.1.0-py3-none-any.whl (35.1 kB view details)

Uploaded Python 3

File details

Details for the file fluxstate_security-1.1.0.tar.gz.

File metadata

  • Download URL: fluxstate_security-1.1.0.tar.gz
  • Upload date:
  • Size: 41.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for fluxstate_security-1.1.0.tar.gz
Algorithm Hash digest
SHA256 c16accb06da9d3907455442cb0c9bdb23b204430f87781996c808ce61954657b
MD5 d3928ff55ef5654bb1ddfd92120653a9
BLAKE2b-256 1882ced3dad12c4fda34812c4b7cf69f79137d10531446fc90f5f64ab6b68098

See more details on using hashes here.

Provenance

The following attestation bundles were made for fluxstate_security-1.1.0.tar.gz:

Publisher: publish.yml on contact-us-gdinexus/fluxstate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fluxstate_security-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for fluxstate_security-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f16e8f1bff4fcffe0b8617133b1a24aafeb62b5681f7595573bf6f42c9c8381e
MD5 13ed3a74da3d21f6c83c030ebdee1701
BLAKE2b-256 8f3172c9c3aa56fedd0c44cef75a8d7238ca7fd02b64d548bc53689717abb50b

See more details on using hashes here.

Provenance

The following attestation bundles were made for fluxstate_security-1.1.0-py3-none-any.whl:

Publisher: publish.yml on contact-us-gdinexus/fluxstate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page