omniintelligence 0.4.0

Intelligence, indexing, and pattern services as first-class Omninode nodes

OmniIntelligence

Intelligence, indexing, and pattern services as first-class Omninode nodes.

Overview

OmniIntelligence is a rebuild of the legacy omniarchon intelligence platform, transformed into a set of canonical ONEX nodes following the Omninode architecture patterns. This migration preserves contract-driven ingestion, vector search, and intelligence APIs while aligning with canonical node standards.

Architecture

The system is decomposed into specialized ONEX nodes:

Orchestrator Nodes

• intelligence_orchestrator - Coordinates ingestion, enrichment, vectorization, and persistence pipelines

Reducer Nodes

• ingestion_reducer - Manages ingestion FSM, state transitions, and lease management

Compute Nodes

• vectorization_compute - Encapsulates embedding generation, scoring, and fallback models
• pattern_learning_compute - Pattern enrichment and learning operations

Effect Nodes

• ingestion_effect - Handles Kafka/Qdrant/PostgreSQL side effects
• intelligence_api_effect - Provides HTTP/Kafka façade for intelligence APIs

Project Structure

omniintelligence/
├── src/
│   └── omniintelligence/
│       ├── nodes/                    # ONEX nodes
│       │   ├── intelligence_orchestrator/
│       │   ├── ingestion_reducer/
│       │   ├── ingestion_effect/
│       │   ├── vectorization_compute/
│       │   ├── pattern_learning_compute/
│       │   └── intelligence_api_effect/
│       ├── adapters/                 # External adapters (HTTP, etc.)
│       ├── shared/                   # Shared models and utilities
│       └── utils/                    # Common utilities
├── tests/
│   ├── unit/                         # Unit tests
│   ├── integration/                  # Integration tests
│   ├── fixtures/                     # Test fixtures
│   └── contracts/                    # Contract validation tests
├── scripts/                          # Automation scripts
├── deployment/                       # Deployment manifests
├── config/                           # Configuration files
├── docs/                             # Documentation
│   └── migrations/                   # Migration guides
└── migration_sources/                # Legacy source reference
    └── omniarchon/                   # Original omniarchon codebase

Setup

Prerequisites

• Python 3.12+
• Poetry or uv for dependency management
• Docker for local infrastructure (Kafka, Qdrant, PostgreSQL, Memgraph)

Installation

# Install core dependencies
uv sync --group core

# Install development dependencies
uv sync --group dev

# Install all dependencies (development + testing)
uv sync --group all

ONEX Ecosystem Dependencies

The omnibase-* packages are published to PyPI and will be installed automatically:

• omnibase-core (>=0.8.0) - ONEX node base classes, error handling, validation
• omnibase-spi (>=0.5.0) - Service Provider Interface protocols
• omnibase-infra (>=0.2.1) - Infrastructure handlers (Kafka, Qdrant, PostgreSQL)

What omnibase-infra provides:

• QdrantVectorHandler - Vector database operations
• KafkaEventBus - Event bus implementation
• BaseRuntimeHostProcess - Process lifecycle management
• Handler implementations for PostgreSQL, Memgraph, etc.

For local development with unpublished versions (optional):

# Install a local checkout for development
uv pip install -e /path/to/your/omnibase_infra

# Or for Poetry users, update pyproject.toml:
# omnibase-infra = {path = "../omnibase_infra", develop = true}

Running Tests

# Run unit tests
pytest tests/unit

# Run integration tests (requires infrastructure)
pytest tests/integration

# Run all tests
pytest

# Run with coverage
pytest --cov=src/omniintelligence --cov-report=html

Development

Node Development Pattern

Each node follows the canonical ONEX structure:

node_name/
├── v1_0_0/                          # Versioned implementation
│   ├── contracts/                   # YAML contract definitions
│   ├── models/                      # Pydantic models
│   ├── node.py                      # Main node implementation
│   ├── introspection.py            # Introspection support
│   ├── scenarios/                   # Integration test scenarios
│   └── node_tests/                  # Node-specific tests
└── __init__.py

Code Quality

# Format code
black src tests
isort src tests

# Lint
ruff check src tests

# Type check
mypy src

Migration from OmniArchon

This project is a migration from the legacy omniarchon system. See:

• Migration Guide
• Legacy Sources

Documentation

• Architecture Overview
• Node Stack Blueprint
• Migration Steps
• Testing Strategy

Migration Freeze

A schema freeze is currently active for this repository as part of the DB-per-repo refactor (OMN-2055). While .migration_freeze exists at the repo root, no new migrations may be added to deployment/database/migrations/.

Allowed during freeze:

• Migration moves (reorg between repos)
• Ownership fixes (table transfers)
• Rollback bug fixes (DB-SPLIT-01 refactor phase)

To lift the freeze: remove .migration_freeze once DB boundary work for omniintelligence is complete.

License

Copyright © 2024 OmniNode Team