Skip to main content

Edge-optimized multimodal RAG framework for video understanding

Project description

VidChain: The "LangChain for Videos"

v0.8.8-Stable — The Definitive Forensic Intelligence Release. Optimized for speed, integrity, and responsiveness on the seminar floor.

Python CUDA License Status PyPI version

Spider-Net Intelligence Portal


High-Integrity Forensic Architecture

VidChain v0.8.8-Stable is powered by the B.A.B.U.R.A.O. Engine (Behavioral Analysis & Broadcasting Unit for Real-time Artificial Observation). This version introduces the Forensic Integrity Hub and Snappy Ingest optimizations.

graph TD
    %% --- Ingestion Stage ---
    subgraph "1. Ingestion & Optimization Layer"
        VS[Video Source] --> AK[Adaptive Gaussian Filter]
        AK -- "Delta > Threshold" --> PK[Promote to Keyframe]
        AK -- "Redundant" --> DROP{{GPU Compute Firewall}}
    end

    %% --- Inference Stage ---
    subgraph "2. Sensory Node Matrix (Late Fusion)"
        PK --> VLM[LlavaNode: Scene Semantics]
        PK --> ASR[WhisperNode: Audio Trace]
        PK --> OCR[OcrNode: Digital Trace]
        PK --> TRK[TrackerNode: Motion Flow]
        
        %% Optional Sensors
        PK -.-> ACT[ActionNode: Situational Verbs]
        PK -.-> EMT[EmotionNode: Sentiment]
    end

    %% --- Intelligence Logic ---
    subgraph "3. B.A.B.U.R.A.O. Cognitive Engine"
        VLM & ASR & OCR & TRK & ACT & EMT --> FUSE[Semantic Fusion Pipeline]
        FUSE --> RDN[Recursive Map-Reduce Summarizer]
    end

    %% --- Persistence ---
    subgraph "4. Forensic Memory Vault"
        FUSE --> KV[(ChromaDB Vector Store)]
        FUSE --> KG[[Temporal Knowledge Graph]]
    end

    %% --- Interaction Stage ---
    subgraph "5. Spider-Net Intelligence Portal"
        USER[User Query] --> IR{Intent Router}
        IR -- "Forensic Search" --> RAG[RAG Retrieval Loop]
        IR -- "Executive Overview" --> RDN
        RAG <--> KV
        RAG <--> KG
        RDN --> REPORT([Intelligence Report])
        RAG --> DISCOVERY([Discovery Hub])
    end

    %% --- Hardware Loop ---
    HM[NVML Hardware Monitor] -.-> AK
    HM -.-> VLM
    HM -.-> DISCOVERY

    style VS fill:#1e1e2e,stroke:#74c7ec,stroke-width:2px;
    style DISCOVERY fill:#11111b,stroke:#a6e3a1,stroke-width:3px;
    style REPORT fill:#11111b,stroke:#a6e3a1,stroke-width:3px;
    style DROP fill:#313244,stroke-dasharray: 5 5;
    style AK fill:#1e1e2e,stroke:#fab387;

Key Features (v0.8.8 Evolution)

Snappy Ingest Optimization [NEW]

Ingestion is now up to 50% faster. By shifting intelligence summarization from a mandatory post-ingest task to an on-demand chat feature, the system marks evidence as READY the millisecond the sensor nodes finish processing.

Forensic Integrity Lock

Strict session-to-video binding. B.A.B.U.R.A.O. now cleans its active memory during every context switch, ensuring zero leakage or "random noises" between investigations.

Flex-Engine Responsive HUD

The Spider-Net Portal now features a collapsible Telemetry HUD and responsive Ingest Bar, ensuring a clean layout on any screen size from laptops to forensic monitors.

Precision Evidence Player

A surgical forensic review tool with frame-by-frame 33ms seeking, real-time semantic heatmap overlays, and hardware-accelerated local media resolution.


Installation

# Core installation
pip install VidChain

# Setup local AI backends (Ollama)
ollama pull moondream   # Optimized Edge VLM (1.7GB)
ollama pull llama3      # Local Reasoning Hub (4.7GB)

# Verify Hardware Readiness (Bundled utility)
python -m vidchain.scripts.check_gpu

📜 Changelog (The Seminar Milestone)

  • v0.8.8: Snappy Ingest. Decoupled auto-summarization from the ingest pipeline for 2x speed.
  • v0.8.7: Flex-Engine Layout. Collapsible HUD, responsive status bar, and UI collision fixes.
  • v0.8.6: Forensic Integrity Hub. Removed dangerous global fallbacks; enforced strict session isolation.
  • v0.8.5: Forensic Flow Restoration. Fixed 404 media reloads and improved rename input UX.
  • v0.8.3: Relative Path Migration. Fixed broken production fetches and asset routing.
  • v0.8.1: Implemented Auto-Launch browser integration for vidchain-serve.
  • v0.8.0: The Modular Revolution. Deprecated monolithic processors for Node framework.

Author

Rahul Sharma — IIIT Manipur
SEM Project Version 0.8.8-Stable

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vidchain-0.8.8.tar.gz (545.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vidchain-0.8.8-py3-none-any.whl (569.5 kB view details)

Uploaded Python 3

File details

Details for the file vidchain-0.8.8.tar.gz.

File metadata

  • Download URL: vidchain-0.8.8.tar.gz
  • Upload date:
  • Size: 545.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.8

File hashes

Hashes for vidchain-0.8.8.tar.gz
Algorithm Hash digest
SHA256 452867ac88f2ca07f211460c40daede87bae8ab60c1664d6f6a5c4f96851672c
MD5 80138fc5f314cc2ff5580a65eaf426ce
BLAKE2b-256 5c3467cf0090eae64584dcec4b177b09901745bef854f0aec89f6b07793cb4c3

See more details on using hashes here.

File details

Details for the file vidchain-0.8.8-py3-none-any.whl.

File metadata

  • Download URL: vidchain-0.8.8-py3-none-any.whl
  • Upload date:
  • Size: 569.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.8

File hashes

Hashes for vidchain-0.8.8-py3-none-any.whl
Algorithm Hash digest
SHA256 bc6d5a6fced37b5c95390f066a3790059daa33663b1cf60bdd8c700b219820e6
MD5 151d821acc238f9e47276d99b561d75f
BLAKE2b-256 ac31cb8a8f6d82819cc702f0c53fa702f1dd86d3f4e9fb29d4d2d3b5b0b423ab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page