Edge-optimized multimodal RAG framework for video understanding
Project description
VidChain: The "LangChain for Videos"
v0.8.8-Stable — The Definitive Forensic Intelligence Release. Optimized for speed, integrity, and responsiveness on the seminar floor.
High-Integrity Forensic Architecture
VidChain v0.8.8-Stable is powered by the B.A.B.U.R.A.O. Engine (Behavioral Analysis & Broadcasting Unit for Real-time Artificial Observation). This version introduces the Forensic Integrity Hub and Snappy Ingest optimizations.
graph TD
%% --- Ingestion Stage ---
subgraph "1. Ingestion & Optimization Layer"
VS[Video Source] --> AK[Adaptive Gaussian Filter]
AK -- "Delta > Threshold" --> PK[Promote to Keyframe]
AK -- "Redundant" --> DROP{{GPU Compute Firewall}}
end
%% --- Inference Stage ---
subgraph "2. Sensory Node Matrix (Late Fusion)"
PK --> VLM[LlavaNode: Scene Semantics]
PK --> ASR[WhisperNode: Audio Trace]
PK --> OCR[OcrNode: Digital Trace]
PK --> TRK[TrackerNode: Motion Flow]
%% Optional Sensors
PK -.-> ACT[ActionNode: Situational Verbs]
PK -.-> EMT[EmotionNode: Sentiment]
end
%% --- Intelligence Logic ---
subgraph "3. B.A.B.U.R.A.O. Cognitive Engine"
VLM & ASR & OCR & TRK & ACT & EMT --> FUSE[Semantic Fusion Pipeline]
FUSE --> RDN[Recursive Map-Reduce Summarizer]
end
%% --- Persistence ---
subgraph "4. Forensic Memory Vault"
FUSE --> KV[(ChromaDB Vector Store)]
FUSE --> KG[[Temporal Knowledge Graph]]
end
%% --- Interaction Stage ---
subgraph "5. Spider-Net Intelligence Portal"
USER[User Query] --> IR{Intent Router}
IR -- "Forensic Search" --> RAG[RAG Retrieval Loop]
IR -- "Executive Overview" --> RDN
RAG <--> KV
RAG <--> KG
RDN --> REPORT([Intelligence Report])
RAG --> DISCOVERY([Discovery Hub])
end
%% --- Hardware Loop ---
HM[NVML Hardware Monitor] -.-> AK
HM -.-> VLM
HM -.-> DISCOVERY
style VS fill:#1e1e2e,stroke:#74c7ec,stroke-width:2px;
style DISCOVERY fill:#11111b,stroke:#a6e3a1,stroke-width:3px;
style REPORT fill:#11111b,stroke:#a6e3a1,stroke-width:3px;
style DROP fill:#313244,stroke-dasharray: 5 5;
style AK fill:#1e1e2e,stroke:#fab387;
Key Features (v0.8.8 Evolution)
Snappy Ingest Optimization [NEW]
Ingestion is now up to 50% faster. By shifting intelligence summarization from a mandatory post-ingest task to an on-demand chat feature, the system marks evidence as READY the millisecond the sensor nodes finish processing.
Forensic Integrity Lock
Strict session-to-video binding. B.A.B.U.R.A.O. now cleans its active memory during every context switch, ensuring zero leakage or "random noises" between investigations.
Flex-Engine Responsive HUD
The Spider-Net Portal now features a collapsible Telemetry HUD and responsive Ingest Bar, ensuring a clean layout on any screen size from laptops to forensic monitors.
Precision Evidence Player
A surgical forensic review tool with frame-by-frame 33ms seeking, real-time semantic heatmap overlays, and hardware-accelerated local media resolution.
Installation
# Core installation
pip install VidChain
# Setup local AI backends (Ollama)
ollama pull moondream # Optimized Edge VLM (1.7GB)
ollama pull llama3 # Local Reasoning Hub (4.7GB)
# Verify Hardware Readiness (Bundled utility)
python -m vidchain.scripts.check_gpu
📜 Changelog (The Seminar Milestone)
- v0.8.8: Snappy Ingest. Decoupled auto-summarization from the ingest pipeline for 2x speed.
- v0.8.7: Flex-Engine Layout. Collapsible HUD, responsive status bar, and UI collision fixes.
- v0.8.6: Forensic Integrity Hub. Removed dangerous global fallbacks; enforced strict session isolation.
- v0.8.5: Forensic Flow Restoration. Fixed 404 media reloads and improved rename input UX.
- v0.8.3: Relative Path Migration. Fixed broken production fetches and asset routing.
- v0.8.1: Implemented Auto-Launch browser integration for
vidchain-serve. - v0.8.0: The Modular Revolution. Deprecated monolithic processors for Node framework.
Author
Rahul Sharma — IIIT Manipur
SEM Project Version 0.8.8-Stable
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vidchain-0.8.8.tar.gz.
File metadata
- Download URL: vidchain-0.8.8.tar.gz
- Upload date:
- Size: 545.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
452867ac88f2ca07f211460c40daede87bae8ab60c1664d6f6a5c4f96851672c
|
|
| MD5 |
80138fc5f314cc2ff5580a65eaf426ce
|
|
| BLAKE2b-256 |
5c3467cf0090eae64584dcec4b177b09901745bef854f0aec89f6b07793cb4c3
|
File details
Details for the file vidchain-0.8.8-py3-none-any.whl.
File metadata
- Download URL: vidchain-0.8.8-py3-none-any.whl
- Upload date:
- Size: 569.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bc6d5a6fced37b5c95390f066a3790059daa33663b1cf60bdd8c700b219820e6
|
|
| MD5 |
151d821acc238f9e47276d99b561d75f
|
|
| BLAKE2b-256 |
ac31cb8a8f6d82819cc702f0c53fa702f1dd86d3f4e9fb29d4d2d3b5b0b423ab
|