Catalyst Brain: O(1) Holographic Key-Value Cache, 1-Bit Inference, and Metacognitive Swarm Engine.
Project description
🧠 Catalyst Brain SDK
Agentic Meta-Swarm Router + O(1) Holographic Memory for Local AI
Catalyst Brain is a patent-pending cognitive proxy architecture operating at the intersection of Agentic AI, Edge intelligence, and LLMOps. It provides Holographic Key-Value Caching (HKVC) coupled with a self-learning metacognitive swarm routing engine (Rain-Q), empowering local open-source LLMs to bypass standard attention memory bottlenecks.
🚀 The Core Breakthroughs
-
⚡ O(1) Holographic Phase Retrieval Standard Transformer KV-Caches scale $O(N)$ linearly with context sequence lengths. Catalyst's
ComplexAccumulatorprojects embeddings deterministically into a 1-Bit BlockCodeVector (BCV) rotation phase space. Memory lookups operate with constant time overhead ($O(1)$) regardless of contextual length. -
💾 8,000x Memory Footprint Reduction Simulated mathematically using standard
bipolarvector structures vs FP16 limits:- Standard 1,000 Tokens (FP16 Attention): ~12.2 GB
- Catalyst HKVC 1,000 Tokens: Exactly 1.53 MB (Constant Bound)
-
🧬 Self-Optimizing Cognitive State Stop writing rigid logic router prompts. Catalyst's
MetacognitionServercreates self-aware feedback loops mimicking neurotransmitters (Dopamine, Acetylcholine). It benchmarks how models respond (using Resonance) and utilizes Hebbian mapping to autonomously proxy tasks to the most suitable open-source agent in your local system.
📦 Installation
Catalyst relies on an extremely fast, underlying Rust hardware acceleration sub-system called catalyst_hdc which escapes the Python GIL for dense geometric vector math operations.
# Safely handles cross-platform Rust C-extension builds via Maturin:
pip install catalyst-brain
🛠️ Usage (Native Apple Silicon MLX)
We support Black-box REST proxying through Ollama, but to tap into real structural memory caching, Catalyst ships natively supported for Apple Silicon via mlx!
import os
from catalyst_brain_api import app
from catalyst_metacognition import get_metacognition
import uvicorn
# 1. Flip on MLX Interception
os.environ["USE_MLX"] = "true"
# 2. Boot the Cognitive Proxy!
uvicorn.run(app, host="0.0.0.0", port=8000)
🤝 Contributing
We welcome research adaptations and system-level Pull Requests as we work toward integrating true Complex-domain accumulators into distributed Edge computing hardware profiles.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file catalyst_brain-0.2.0.tar.gz.
File metadata
- Download URL: catalyst_brain-0.2.0.tar.gz
- Upload date:
- Size: 77.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
566e122df87675679d999311d36cb009b202ada7a6daca9c5b5126aafb5a5f5b
|
|
| MD5 |
b985188f9e5800ce1afe1a7fc45bee9e
|
|
| BLAKE2b-256 |
b3895c4590b90b65b94d247915df3e06808e17e97748261fa03b0285312add5e
|