Skip to main content

Agent orchestration platform — hardware-aware routing, MCP server, swarm intelligence, OpenAI-compatible

Project description

NeuralBroker 2.0 — Swarm-Native Orchestration Platform

NeuralBroker logo

VRAM-aware LLM routing · Zero-Trust Federation · MCP Server · Agentic Swarms

Python PyPI License: MIT FastAPI Website


The Ultimate Agent Orchestration Platform

NeuralBroker 2.0 transforms your machine into a Swarm-Native Orchestration Node. It goes far beyond standard model routing. It automatically evaluates your hardware, runs localized HNSW-vector memory, coordinates multi-agent task pipelines, and securely talks to other machines across the internet via Zero-Trust Federation.

pip install neuralbrok
neuralbrok start

That's it. Point Claude Code, Cursor, or any OpenAI-compatible app at localhost:8000/v1 (or connect via the built-in MCP server), and the Swarm takes over.


🌟 What's New in v2.0

1. Agentic Swarms & Task Coordination

NeuralBroker doesn't just route prompts; it routes objectives. The built-in SwarmCoordinator decomposes complex user requests into Plan → Execute → Review pipelines, automatically picking the best specialized local agent (Coder, Planner, Reviewer, Analyst) for each subtask.

2. NeuralFit Hardware Intelligence

Powered by a native Python implementation of our advanced hardware scoring algorithm, NeuralBroker scores models across Quality, Speed, Fit, and Context based on your exact hardware specifications (NVIDIA, Apple Silicon, AMD, or CPU). Run neuralbrok fit to see your live VRAM projections and tok/s estimates.

3. AgentDB (Vector Memory) & ReasoningBank

NeuralBroker now features a zero-dependency HNSW-style Vector Store built on NumPy. When your Swarms succeed at a complex task, the execution trajectory is saved into the ReasoningBank. Future agents automatically inject this historical context to solve similar problems faster.

4. Zero-Trust Federation (Agent-to-Agent Comms)

Swarms can now securely communicate across networks. Using our local mTLS/Ed25519-style crypto module, your agents can encrypt and sign payloads and send them to other NeuralBroker nodes. Untrusted nodes are automatically downgraded. Run neuralbrok federation init to start.

5. Security & AIDefence

Every prompt is now scrubbed.

  • PII Redaction: AWS keys, emails, and SSNs are automatically masked before reaching cloud LLMs.
  • Injection Shield: Federated incoming requests are heuristically scanned for adversarial jailbreaks ("ignore previous instructions").

6. Background Workers (Autopilot)

When your machine is idle, NeuralBroker wakes up. The internal WorkerDaemon launches background tasks to optimize codebases and run simulated security audits while you sleep.

7. MCP Server & Dynamic Plugins

NeuralBroker is now a native Model Context Protocol (MCP) server via stdio. Connect Claude Code directly to it. Want more agents? You can dynamically load .yaml agent definitions into your ~/.neuralbrok/plugins/ directory and share them with the community. Run neuralbrok plugins list to view.


🚀 Subscription Inheritance

You already pay for Claude Pro. NeuralBroker lets every app on your machine use it — automatically, for free. It reads the OAuth session your Claude Code CLI holds in ~/.claude/.credentials.json and uses the claude binary as a free inference backend for hard tasks that spill over from your local GPU.

from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="any-string")
response = client.chat.completions.create(
    model="claude-sonnet-4-6",
    messages=[{"role": "user", "content": "Hello"}]
)
# Routed through your Claude Pro subscription. Cost: $0.

💻 Quickstart

1. Install & Start

pip install neuralbrok
neuralbrok start

2. Check Hardware Fit

neuralbrok fit

3. Start the MCP Server (For Claude Code/Cursor)

neuralbrok mcp

4. View Dashboard

Open http://localhost:8000/dashboard to view the live Pink Matrix telemetry UI, complete with routing waterfalls and VRAM gauges.


🔌 API & Integrations

NeuralBroker serves standard endpoints:

  • POST /v1/chat/completions (OpenAI format)
  • POST /nb/federation/receive (Zero-Trust node comms)
  • GET /nb/hardware (Telemetry)

Auto-Configured Integrations:

Run neuralbrok integrations setup <ide_name> to automatically connect:

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Cline
  • ...and 15+ more.

🛠️ Development

git clone https://github.com/khan-sha/neuralbroker.git
cd neuralbroker
python3 -m venv .venv && source .venv/bin/activate
pip install -e .
pytest tests/

MIT License — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

neuralbrok-2.1.1.tar.gz (156.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbrok-2.1.1-py3-none-any.whl (181.9 kB view details)

Uploaded Python 3

File details

Details for the file neuralbrok-2.1.1.tar.gz.

File metadata

  • Download URL: neuralbrok-2.1.1.tar.gz
  • Upload date:
  • Size: 156.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for neuralbrok-2.1.1.tar.gz
Algorithm Hash digest
SHA256 c27edaef788cb824c8585628b1b6e315817ed504a30c6742851de662a86d7258
MD5 40fb003e3aa9ddd00c093b994bf1bdee
BLAKE2b-256 728cdb7c77c85768f65793db61b96504ce70dae62dddbcec9576a31fbe319fd2

See more details on using hashes here.

Provenance

The following attestation bundles were made for neuralbrok-2.1.1.tar.gz:

Publisher: pypi-publish.yml on khan-sha/neuralbroker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file neuralbrok-2.1.1-py3-none-any.whl.

File metadata

  • Download URL: neuralbrok-2.1.1-py3-none-any.whl
  • Upload date:
  • Size: 181.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for neuralbrok-2.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e3eb62c9b79ebacdc818466f21811c58a965912d52bc9e844880323499b32476
MD5 980f8a48f1d0c367d35a7bf27e2f204b
BLAKE2b-256 ea2c920b29c75fe1dc4c814ce55cc609e914b1282f80cf6eeda8e665297d834f

See more details on using hashes here.

Provenance

The following attestation bundles were made for neuralbrok-2.1.1-py3-none-any.whl:

Publisher: pypi-publish.yml on khan-sha/neuralbroker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page