Skip to main content

Agent orchestration platform — hardware-aware routing, MCP server, swarm intelligence, OpenAI-compatible

Project description

NeuralBroker 2.0 — Swarm-Native Orchestration Platform

NeuralBroker logo

VRAM-aware LLM routing · Zero-Trust Federation · MCP Server · Agentic Swarms

Python PyPI License: MIT FastAPI Website


The Ultimate Agent Orchestration Platform

NeuralBroker 2.0 transforms your machine into a Swarm-Native Orchestration Node. It goes far beyond standard model routing. It automatically evaluates your hardware, runs localized HNSW-vector memory, coordinates multi-agent task pipelines, and securely talks to other machines across the internet via Zero-Trust Federation.

pip install neuralbrok
neuralbrok start

That's it. Point Claude Code, Cursor, or any OpenAI-compatible app at localhost:8000/v1 (or connect via the built-in MCP server), and the Swarm takes over.


🌟 What's New in v2.0

1. Agentic Swarms & Task Coordination

NeuralBroker doesn't just route prompts; it routes objectives. The built-in SwarmCoordinator decomposes complex user requests into Plan → Execute → Review pipelines, automatically picking the best specialized local agent (Coder, Planner, Reviewer, Analyst) for each subtask.

2. NeuralFit Hardware Intelligence

Powered by a native Python implementation of our advanced hardware scoring algorithm, NeuralBroker scores models across Quality, Speed, Fit, and Context based on your exact hardware specifications (NVIDIA, Apple Silicon, AMD, or CPU). Run neuralbrok fit to see your live VRAM projections and tok/s estimates.

3. AgentDB (Vector Memory) & ReasoningBank

NeuralBroker now features a zero-dependency HNSW-style Vector Store built on NumPy. When your Swarms succeed at a complex task, the execution trajectory is saved into the ReasoningBank. Future agents automatically inject this historical context to solve similar problems faster.

4. Zero-Trust Federation (Agent-to-Agent Comms)

Swarms can now securely communicate across networks. Using our local mTLS/Ed25519-style crypto module, your agents can encrypt and sign payloads and send them to other NeuralBroker nodes. Untrusted nodes are automatically downgraded. Run neuralbrok federation init to start.

5. Security & AIDefence

Every prompt is now scrubbed.

  • PII Redaction: AWS keys, emails, and SSNs are automatically masked before reaching cloud LLMs.
  • Injection Shield: Federated incoming requests are heuristically scanned for adversarial jailbreaks ("ignore previous instructions").

6. Background Workers (Autopilot)

When your machine is idle, NeuralBroker wakes up. The internal WorkerDaemon launches background tasks to optimize codebases and run simulated security audits while you sleep.

7. MCP Server & Dynamic Plugins

NeuralBroker is now a native Model Context Protocol (MCP) server via stdio. Connect Claude Code directly to it. Want more agents? You can dynamically load .yaml agent definitions into your ~/.neuralbrok/plugins/ directory and share them with the community. Run neuralbrok plugins list to view.


🚀 Subscription Inheritance

You already pay for Claude Pro. NeuralBroker lets every app on your machine use it — automatically, for free. It reads the OAuth session your Claude Code CLI holds in ~/.claude/.credentials.json and uses the claude binary as a free inference backend for hard tasks that spill over from your local GPU.

from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="any-string")
response = client.chat.completions.create(
    model="claude-sonnet-4-6",
    messages=[{"role": "user", "content": "Hello"}]
)
# Routed through your Claude Pro subscription. Cost: $0.

💻 Quickstart

1. Install & Start

pip install neuralbrok
neuralbrok start

2. Check Hardware Fit

neuralbrok fit

3. Start the MCP Server (For Claude Code/Cursor)

neuralbrok mcp

4. View Dashboard

Open http://localhost:8000/dashboard to view the live Pink Matrix telemetry UI, complete with routing waterfalls and VRAM gauges.


🔌 API & Integrations

NeuralBroker serves standard endpoints:

  • POST /v1/chat/completions (OpenAI format)
  • POST /nb/federation/receive (Zero-Trust node comms)
  • GET /nb/hardware (Telemetry)

Auto-Configured Integrations:

Run neuralbrok integrations setup <ide_name> to automatically connect:

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Cline
  • ...and 15+ more.

🛠️ Development

git clone https://github.com/khan-sha/neuralbroker.git
cd neuralbroker
python3 -m venv .venv && source .venv/bin/activate
pip install -e .
pytest tests/

MIT License — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

neuralbrok-2.1.2.tar.gz (156.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbrok-2.1.2-py3-none-any.whl (182.1 kB view details)

Uploaded Python 3

File details

Details for the file neuralbrok-2.1.2.tar.gz.

File metadata

  • Download URL: neuralbrok-2.1.2.tar.gz
  • Upload date:
  • Size: 156.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for neuralbrok-2.1.2.tar.gz
Algorithm Hash digest
SHA256 b825aed241a8e74d18c82d08623679064e85cf1cf478b25d88bd3628aac47e78
MD5 5540b1715bbafdd4a27ff01cf5486bf2
BLAKE2b-256 0983ca718523bae99d4c5186c85e0d6199d9ec2a053e46a4a5635974acf1db80

See more details on using hashes here.

Provenance

The following attestation bundles were made for neuralbrok-2.1.2.tar.gz:

Publisher: pypi-publish.yml on khan-sha/neuralbroker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file neuralbrok-2.1.2-py3-none-any.whl.

File metadata

  • Download URL: neuralbrok-2.1.2-py3-none-any.whl
  • Upload date:
  • Size: 182.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for neuralbrok-2.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 8baeb0bef1cf443abd58977ff3968ac5cb018e92e88e6f2970a34cf62c5666b5
MD5 6080e399916fd4c7ebf6b6555e3ab029
BLAKE2b-256 94b6334f7621e4d116d553a9c64b7c7f55ac9ab087f90889300d19e9d3ae8158

See more details on using hashes here.

Provenance

The following attestation bundles were made for neuralbrok-2.1.2-py3-none-any.whl:

Publisher: pypi-publish.yml on khan-sha/neuralbroker

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page