Skip to main content

Intent-classification preselector for agent runtimes — open the library, hide the cost

Project description

mind-nerve

Intent-classification preselector for agent runtimes.

A small, fast classifier that sits between a user request and the host runtime. It reads the request, decides which subset of available tools/skills/agents is relevant, and hands the host a short list — so the downstream LLM never sees the full library in its system prompt.

The result: library size decouples from token cost. Hosting 4,400 skills costs the same prompt budget as hosting 44, because only the top-K are ever loaded per turn.

Status

Phase 1 — public alpha (v0.1.0-alpha.5, 2026-05-16). Python wheel on PyPI; weights on Hugging Face. The router runs end-to-end on PyTorch via BAAI/bge-small-en-v1.5 fine-tuned with MultipleNegativesRankingLoss; top-5 accuracy is 96.06 % against the v1.1-oss catalog of 11,922 routing candidates.

MIND Language Profile target: default (full tensor stdlib + Q16.16 + heap) — see mind Phase 10.6 for the --profile flag landing in mindc 0.2.6.

Phase 2 replaces the PyTorch path with a native MIND Q16.16 inference loop and adds the cross-architecture bit-identity gate + 4-core CPU p95 ≤ 30 ms latency budget. Phase 2 is gated on mindc 0.2.6 (pub fn → C symbol export) and 0.3.0 (cdylib emit). Until Phase 2 closes, the inference path uses external ML tooling — explicitly permitted by the ROADMAP Phase 1 exception.

Quickstart

pip install mind-nerve
from mind_nerve import route
result = route("git status", top_k=5)
for r in result.routes:
    print(r.score, r.name, r.kind)

Pre-download the runtime once and point MIND_NERVE_RUNTIME_DIR at it:

huggingface-cli download star-ga/mind-nerve-phase1 --local-dir ~/.mind-nerve/phase1
export MIND_NERVE_RUNTIME_DIR=~/.mind-nerve/phase1

Auto-download on first route() call is on the 0.1.0a4 backlog.

Why this exists

Agent runtimes today load entire skill/tool/MCP libraries into the LLM's system prompt on every turn. At small scale this is fine. At hundreds of skills, the prompt-cache and per-call token cost become the binding constraint on library growth.

Standard responses to this problem all degrade either correctness or latency:

  • Vector-only retrieval over skill descriptions loses precise intent matching
  • LLM-based routing pays full inference cost just to decide what to load
  • Manual skill grouping shifts the problem onto the operator

mind-nerve takes the third option: a purpose-built sub-50M-parameter classifier that runs in tens of milliseconds on CPU, returns top-K relevant routes, and is small enough to call on every turn without paying real cost.

Integration surface

mind-nerve exposes a single contract across two host classes:

  • Claude Code, codex, gemini, vibe, and 13 other CLIs — preselects which agent skills load into the system prompt for a given turn
  • MCP servers — preselects which tools are surfaced as candidates before the calling LLM sees the full registry

Same model, same binary, same evidence chain — both host targets.

Design constraints (non-negotiable)

  • Latency p95 ≤ 30 ms on CPU. If we miss this, the preselector becomes the bottleneck instead of relieving it.
  • Cross-architecture bit-identity. Same request on x86, ARM, CUDA, WebGPU returns the same top-K. Q16.16 fixed-point throughout, no IEEE-754 fallback in the inference path.
  • No training data leakage at inference. The classifier reveals only route names, never the training corpora content.
  • Tamper detection. Every inference emits an attestation envelope tying the request hash, model hash, and result hash into the evidence chain.

Architecture (one paragraph)

Asymmetric encoder/decoder with a classifier head. Encoder reads the request, no feed-forward blocks (attention + gated residuals only) for compact representation. Decoder cross-attends to the encoder output and to a fixed embedding of every available route (skills/tools/agents). Classifier head emits per-route relevance scores. Top-K extraction is deterministic tie-breaking by route ID hash. Full spec in spec/architecture.md.

Repository structure

mind-nerve/
  README.md                       this file
  ROADMAP.md                      phased delivery plan
  LICENSE.md                      Apache-2.0 architecture, weights separate
  spec/                           authoritative design documents
    architecture.md
    quality_targets.md
    integration_surface.md
  src/                            pure MIND implementation
    lib.mind
    model.mind
    inference.mind
    evidence.mind
  cli/
    main.mind                     single-binary entrypoint
  integrations/
    claude-code/                  TypeScript hook shim
    codex/                        shell hook wrapper
    mcp/                          MCP server façade
  tests/
    bit_identity/                 cross-architecture reproducibility
    accuracy/                     classification benchmarks

License

mind-nerve ships under Apache-2.0 — repository, Python wheel, and the Phase-1 trained weights on Hugging Face all carry the same license. The wheel additionally bundles libmindnerve.so, a FORTRESS-protected runtime component whose source remains private under STARGA Commercial terms. The protected binary is the future Phase-2 native inference layer; the Phase-1 PyTorch path does not depend on it.

For commercial deployments needing per-customer FORTRESS-locked builds of the runtime layer, contact license@star.ga. See LICENSE.md for the full split.

Dependencies

  • numpy, sentence-transformers, torch — Phase-1 inference path
  • mind-runtime — Phase-2 native inference (gated on mindc 0.3.0)
  • mind-mem (optional) — consumes mind-nerve preselection for tool routing

The "no third-party ML framework" goal applies to Phase 2. Phase 1 (this release) deliberately uses sentence-transformers + PyTorch to ship the API, evaluation harness, and integration surface before the native runtime lands.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mind_nerve-0.1.0a5.tar.gz (34.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mind_nerve-0.1.0a5-py3-none-any.whl (33.3 kB view details)

Uploaded Python 3

File details

Details for the file mind_nerve-0.1.0a5.tar.gz.

File metadata

  • Download URL: mind_nerve-0.1.0a5.tar.gz
  • Upload date:
  • Size: 34.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for mind_nerve-0.1.0a5.tar.gz
Algorithm Hash digest
SHA256 fa020cbefc63a78d11f6898c66c72d7d0ff70fa72278f7d9c2aa47af67d5bea9
MD5 a51fd4ff2ab9f6c6a7dfe8c96afb7b39
BLAKE2b-256 8b3bbb515697ef4f83c1dbe91a2dafe3f562a5bcd18fff9d72c000e966d9f358

See more details on using hashes here.

File details

Details for the file mind_nerve-0.1.0a5-py3-none-any.whl.

File metadata

  • Download URL: mind_nerve-0.1.0a5-py3-none-any.whl
  • Upload date:
  • Size: 33.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for mind_nerve-0.1.0a5-py3-none-any.whl
Algorithm Hash digest
SHA256 2a34d866b84151cb15d87ffc14f817db37555148c2f58f66118f5bc5ef717405
MD5 4840b1e253a3ce823685d017175c70ae
BLAKE2b-256 d3998be1bab7a635d488f547072ac15aea251d2f9b9451638224cd26a9b1334a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page