Multimodal AI Framework for Robotics
Project description
OmniTrain v2.1.0: Conectoma
Bio-Inspired Sparse Neural Circuits & Formal Safety for Robotics
[!WARNING] This project is currently UNFINISHED and in PRE-BETA phase. Core features and APIs are undergoing active development, testing, and security audits. Use with caution.
OmniTrain is a production-grade framework for building Bio-Inspired Conectomas (Hub & Wall architecture). It utilizes Closed-form Continuous-time (CfC) networks and Input Convex Neural Networks (ICNN) to provide sub-millisecond, provably safe robotic control on edge hardware (Jetson/Qualcomm).
What's New in v2.1 (Update)
- Training-Serving Parity: Automatic capture and application of Z-Score normalization statistics. No more data degradation in deployment.
- Lagrangian Stability: Stabilized primal-dual safety controller using per-sequence dual updates.
- Unified Fusion: Optimized multi-sensor ingestion in
OmniStreamto prevent neural double-evolution. - Kernel Robustness: Enhanced CLI with kernel-level exception handling for 24/7 mission-critical operation.
- Hardware Failsafes: Improved Tier 1 monitoring with worst-case coverage across all sensor dimensions.
- Stabilization: Passed the Integrity 5-Problem Health Audit (v2.1) ensuring zero-leak SHM and RK4 dynamics parity.
Quick Start
1. Installation
git clone https://github.com/Mrmyms/Omnitrain.git
cd Omnitrain
chmod +x setup.sh
./setup.sh
1.1 Windows Installation
git clone https://github.com/Mrmyms/Omnitrain.git
cd Omnitrain
python -m venv .venv
.venv\Scripts\activate
pip install -r requirements.txt
pip install -e .
2. Scaffold a New Project
from omnitrain import ProjectManager
# Set up project folders, default config.yaml, and a training dataset
ProjectManager.init_project()
3. Programmatic Training Curriculum
from omnitrain import LiquidTrainer
# Load trainer and fit behavioral and safety policies
trainer = LiquidTrainer("config.yaml")
metrics = trainer.fit("robot_logs.csv", epochs=5)
4. Edge Deployment Compile
from omnitrain import EdgeDeployer
# Compile brain checkpoint to optimized ONNX or Qualcomm Snapdragon DLC format
deployer = EdgeDeployer("models/bot_brain.omni")
deployer.export(target="tensorrt")
5. Multi-process Sensor Runner
from omnitrain import AgentRunner
# Start the real-time TokenBus circular buffer and spawn sensor modalities
runner = AgentRunner("config.yaml")
runner.start()
# Monitor live circular buffer stream telemetry for 10 seconds
runner.run_telemetry(duration=10.0)
runner.stop()
Architecture: The Conectoma v2.1
graph TD
S1[Sensors] -->|Z-Score Normalization| H[BioConectomaHub]
subgraph "Hub & Wall"
H -->|Sparse Mask| W[Interneuron Wall]
W -->|Recurrent| W
W -->|Decision| C[Command Layer]
end
C -->|Safe Action| SG[OmniShield v2.1]
SG -->|Convex Barrier| M[Motor Output]
style H fill:#d1f2ff,stroke:#333
style W fill:#fff4d1,stroke:#333
Resources
- Technical Deep Dive & Conectoma Spec: Official architecture specification, CfC cells, and ICNN barriers.
- Theoretical Frameworks: Liquid Networks, ICNNs, and CTMT math.
- Connectivity Guide: Connecting sensors (ROS 2, Isaac Sim, CSV) to TokenBus.
- LNN Research Database: MIT CSAIL papers, benchmarks, and LNN/CfC references.
- Training Pipeline: 5-phase curriculum (Imitation, Safety, Noise, Lagrangian Stability, Pruning).
OmniTrain Team "Fuse Everything. Trust Nothing. Verify Formally."
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file omnitrain-1.0.1.tar.gz.
File metadata
- Download URL: omnitrain-1.0.1.tar.gz
- Upload date:
- Size: 73.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
38417c4a724d30defa4137f66fc2491d9cc01ae5f6a9e96116df6749109a92a3
|
|
| MD5 |
341704cbefc96460555afa94c778ad5a
|
|
| BLAKE2b-256 |
54ac7b99bcfafeb172fbd88929345f234fa8f530ebca1f48dac6f0b01c46de06
|
File details
Details for the file omnitrain-1.0.1-cp314-cp314-macosx_26_0_arm64.whl.
File metadata
- Download URL: omnitrain-1.0.1-cp314-cp314-macosx_26_0_arm64.whl
- Upload date:
- Size: 170.6 kB
- Tags: CPython 3.14, macOS 26.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c4630c61f31c6e7fc0cc2d06c37edb3093b0bfc506c1a1931d63f0989f3dd52a
|
|
| MD5 |
f47b7c91f25de4bc0b4baaf05b47b2bf
|
|
| BLAKE2b-256 |
635b9d569a0f795c5a5f7ff833c4df6de1f926c7eccfbfd9e941d6ea1fb18bd9
|