Skip to main content

GPU-accelerated RAG module for vaultspec vault search

Project description

vaultspec-rag

Python CI MCP uv License: MIT


Semantic search for your vaultspec vault and project codebase

vaultspec-rag adds GPU-accelerated search to projects managed by vaultspec-core. It indexes your .vault/ documents -- research notes, architecture decisions, plans, execution logs -- alongside your source code. Query both with natural language so your AI tools find relevant context on their own.


Getting started

Prerequisites

  • Python 3.13 or later
  • uv
  • A CUDA GPU with at least 3 GB VRAM (mandatory -- no CPU fallback)
  • vaultspec-core

Install

uv add vaultspec-rag
uv run vaultspec-rag install

The first command pulls in vaultspec-core and all GPU dependencies. The second seeds vaultspec-rag's bundled rule/MCP files into the workspace and patches your pyproject.toml with the cu130 torch index so uv resolves the CUDA torch wheel on Linux and Windows (macOS is left on PyPI torch). You'll be prompted before the pyproject.toml edit; pass --yes to skip the prompt (required in non-TTY contexts) or --no-torch-config to opt out. Add --sync to run uv sync --reinstall-package torch automatically after the patch.

After install, run vaultspec-rag --version and then vaultspec-rag index as usual.

Manual cu130 configuration

If you'd rather configure the cu130 torch index by hand (air-gapped environments, custom resolvers), add this to your pyproject.toml:

[[tool.uv.index]]
name = "pytorch-cu130"
url = "https://download.pytorch.org/whl/cu130"
explicit = true

[tool.uv.sources]
torch = [
    { index = "pytorch-cu130", marker = "sys_platform == 'linux' or sys_platform == 'win32'" },
]

then run uv sync --reinstall-package torch. [tool.uv.sources] declarations in a dependency's own pyproject.toml do not propagate to consumers, which is why this step is necessary.

Troubleshooting: "PyTorch was installed without CUDA support"

If vaultspec-rag index reports the CPU-only wheel on a machine with a GPU, uv resolved torch from PyPI (which only ships CPU wheels on Linux/Windows) because the cu130 index isn't yet configured. Run vaultspec-rag install — or apply the manual snippet above — and uv sync --reinstall-package torch. The No CUDA GPU detected error is now reserved for the genuinely GPU-less case (driver missing, headless VM without a device, etc.).

Verify

vaultspec-rag --version

Index and search

vaultspec-rag indexes two sources: vault (.vault/ documents) and code (project source files).

vaultspec-rag index                          # both
vaultspec-rag index --type vault             # vault only
vaultspec-rag index --type code              # code only

vaultspec-rag search "architecture decision"
vaultspec-rag search --type code "error handling"

Using the MCP server

The Model Context Protocol (MCP) server gives AI assistants direct access to vault and codebase search. It runs in two transport modes with different project-resolution rules.

stdio mode -- one process per project. The MCP client launches vaultspec-search-mcp as a subprocess, scoped to a single workspace via VAULTSPEC_RAG_ROOT. Use this for Claude Desktop, Claude Code, and similar single-project AI tools.

{
  "mcpServers": {
    "vaultspec-rag": {
      "command": "vaultspec-search-mcp",
      "env": {
        "VAULTSPEC_RAG_ROOT": "/path/to/your/project"
      }
    }
  }
}

HTTP mode -- one daemon, many projects. Start vaultspec-rag server service start as a background daemon, then connect any MCP client to http://127.0.0.1:8766/mcp. The daemon has no default project; every tool call must include project_root. Use this to share one GPU-loaded service across workspaces.

See the MCP integration reference for the full tool list, both modes' contracts, and choosing between them.


Further reading

Guide What it covers
Usage modes Ad-hoc vs. service operation
CLI commands Command tree, flags, --port fast path
Configuration Precedence, environment variables, .vaultragignore
Service management Background daemon, health endpoint, model warmup
Python API Facade functions for programmatic use
Architecture overview Access layers, GPU lifecycle, multi-project support
Models Embedding stack and model cards

Getting help

Open an issue on GitHub.


Contributing and license

Contributions welcome -- bug reports, feature ideas, or pull requests. vaultspec-rag uses the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vaultspec_rag-0.2.3.tar.gz (843.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vaultspec_rag-0.2.3-py3-none-any.whl (224.9 kB view details)

Uploaded Python 3

File details

Details for the file vaultspec_rag-0.2.3.tar.gz.

File metadata

  • Download URL: vaultspec_rag-0.2.3.tar.gz
  • Upload date:
  • Size: 843.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for vaultspec_rag-0.2.3.tar.gz
Algorithm Hash digest
SHA256 91786e535e63c437bcd22b1f41404195b0cacaeef36cbe76afe1c18fa03d5262
MD5 96f239acfcb3fa1d3a05f5298827a01d
BLAKE2b-256 2da5d492a2b05048813bdd0adf623eadb4ccb712eb98cd0cc332e22c3a42bf19

See more details on using hashes here.

File details

Details for the file vaultspec_rag-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: vaultspec_rag-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 224.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for vaultspec_rag-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 da8c6f1d3289c26a92ed5e79a54f58432f4d1fb277de9211f3b8cf443676a10f
MD5 780f7b2848ad1d6ff3e38b3d26f263aa
BLAKE2b-256 c32c8aee64a9f8884b84992dadf63e5637b3031c14cf9eaa807bb86ec1a5517a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page