minirag-mcp
A local-first RAG (retrieval-augmented generation) MCP server. Point it at a folder of documents and it gives your MCP client (Claude Code, Cursor, Codex, ...) hybrid search — semantic vector similarity plus a keyword boost for exact terms — over that content.
Nothing leaves your machine except two things: the one-time embedding-model
download on first use, and the explicit ingest_url call when you ask it to
fetch a web page. Ingesting local files, indexing, and querying never touch
the network.
It is a Python, MCP-native analog of shinpr/mcp-local-rag (TypeScript), built on fastmcp, fastembed, and LanceDB.
Features
- Hybrid search — vector similarity (fastembed/ONNX) fused with keyword ranking (LanceDB BM25 full-text search) by weighted Reciprocal Rank Fusion, so exact identifiers and error codes surface alongside semantically similar passages.
- Filenames are searchable — keyword search covers document titles as well as body text, and an informative filename becomes the document's title when the document's own heading is boilerplate. In many real document sets the filename is the only place the document code and subject appear at all. See Titles and filenames.
- Multilingual by default — the default embedding model covers 50+ languages, so English and Russian corpora both work out of the box.
- Chunks sized in tokens, passages returned whole — what gets ranked is a small unit that fits the embedding model's 128-token ceiling; what comes back is the section around it — a transcript time window, a heading section, a slide, a table. See Chunking.
- 12 file formats ingested via
markitdown(PDF, DOCX, PPTX, XLSX, HTML, CSV, EPUB, Jupyter notebooks, Markdown, and plain text), plus direct text/markdown/HTML ingestion and URL fetching. - MCP server and CLI over the same index — inspect and manage the index from a terminal without going through an MCP client.
- Degrades gracefully — a broken configuration doesn't crash the server;
every tool reports the error and
statusalways answers. - No hidden network calls — see Security and Operation.
Quick Start
Every client below launches the same process; only the config format differs.
Replace /absolute/path/to/docs with the folder you want indexed.
The invocation is uvx minirag-mcp. It resolves and caches the package on
first run, so start-up is slow once and fast afterwards.
uvx resolves that name from PyPI, so the snippets below work from release
0.1.0 onward; on an earlier revision use From an unreleased
revision instead. That distinction is worth
checking before you paste: claude mcp add writes the entry without ever
running the command, so an unresolvable package looks like a successful setup
and only fails later, silently, when the client tries to launch the server.
Claude Code
claude mcp add minirag --scope user --env BASE_DIR=/absolute/path/to/docs \
-- uvx minirag-mcp
Cursor (~/.cursor/mcp.json)
{
"mcpServers": {
"minirag": {
"command": "uvx",
"args": ["minirag-mcp"],
"env": {
"BASE_DIR": "/absolute/path/to/docs"
}
}
}
}
Codex (~/.codex/config.toml)
[mcp_servers.minirag]
command = "uvx"
args = ["minirag-mcp"]
[mcp_servers.minirag.env]
BASE_DIR = "/absolute/path/to/docs"
From an unreleased revision
To run a revision that hasn't been released to PyPI — an unreleased fix, or one
specific commit — install from this repository instead. In any snippet above,
replace uvx minirag-mcp with:
uvx --from git+https://github.com/sfrangulov/minirag-mcp minirag-mcp
As an argument list, that is ["--from", "git+https://github.com/sfrangulov/minirag-mcp", "minirag-mcp"].
Append @<tag-or-sha> to the URL to pin a revision.
From a clone
For development, or to run the CLI against a working tree you can edit:
git clone https://github.com/sfrangulov/minirag-mcp
cd minirag-mcp
uv sync
uv run minirag-mcp status --base-dir /absolute/path/to/docs
First use
The index starts empty — nothing is scanned until you ask for it:
- Ask your client to sync: "sync minirag" (calls
sync_start, then pollsync_statusuntil it reportssucceeded). From a terminal you can do the same thing synchronously:minirag-mcp sync --base-dir /absolute/path/to/docs. - Then query: "search minirag for ..." (calls
query_documents).
The first sync (or the first ingest of any kind) downloads the embedding model — see Requirements.
Requirements
- Python 3.11+
- uv (provides
uvx) - ~220 MB of disk space and a network connection the first time a document is ingested — fastembed downloads the quantized ONNX weights for the default model and caches them; every ingestion after that is fully offline.
Supported Content
Files under the document root(s) with one of these 12 extensions are picked
up by sync_start/sync and ingest_file/ingest, converted to Markdown by
markitdown:
.md .markdown .txt .pdf .docx .pptx .xlsx .html .htm .csv
.epub .ipynb
Embedded pictures are not indexed. markitdown inlines each one as an
 placeholder — 8.5% of chunks on a measured
558-document corpus carried one — so the placeholder is removed before
chunking and only its alt text is kept. Image links that point at a path or an
http URL are references, not inlined pictures, and stay as written, as does a
data: URI inside a fenced code block.
Two more ways to get content in without a file on disk:
ingest_data— hand the server text, Markdown, or HTML content directly (format: text|markdown|html), under asourceid you choose.ingest_url— the server fetches anhttp/httpsURL itself viamarkitdown'sconvert_url(YouTube, Wikipedia, and RSS get format-specific handling automatically). This is the one tool that reaches the network. Private and local hosts are refused unlessALLOW_PRIVATE_URLSsays otherwise — see Security and Operation.
Chunking
Two units, deliberately separated.
The retrieval unit is what gets embedded and ranked, and it is sized in
tokens, not characters, because the constraint is a token limit. The
default model publishes max_seq_length: 128 and that is its trained
sequence length, not a misconfiguration — text past position 128 is not ranked
badly, it is never seen. The budget is 110 tokens by default, counted with the
model's own tokenizer, leaving margin for text that tokenizes worse than
average. The counter runs that tokenizer with truncation disabled: the
tokenizer fastembed hands out stops at 128, and a counter that cannot tell 128
tokens from 900 is not a counter — compared against a budget of 128 it reports
"within budget" for a text of any length.
Why that matters, measured on a real 558-document Russian corpus with the tokenizer itself: prose runs at ~3.3 characters per token and markdown table rows at ~2.2. Under the previous character-based scheme, 14.7% of the 50,575 chunks were over the ceiling and 22.8% of every token stored was discarded before it reached the model. A character budget cannot fix that, because the ratio it would have to assume differs by 50% between prose and tables.
The parent section is what a caller reads. text is the passage that
matched and that score describes; parentId names the section it sits in,
and query_documents returns a parents map from that id to the section's
text. It is a map rather than a field on each hit because several hits of one
query routinely land in the same section — that is what a good chunking scheme
does — and repeating the section per hit made about a third of a response the
same words resent. The section costs no extra storage either: chunks cut from
one section share the parentId, and the section is rebuilt from them on
demand.
read_file reconstructs a document the same way rather than concatenating its
chunks. Each chunk repeats whatever context its own vector needed — a heading
breadcrumb, a table's header row — and printing that once per chunk inflated
the document by 22% at the median and 2.64x at the tail, and put a header row
in the middle of a table.
Splitting is structure-first, and the category is read off the converted
Markdown rather than the file extension, since one .docx covers transcripts,
specifications and instructions alike:
| Detected as | Section (returned) | Retrieval unit |
|---|---|---|
| Transcript — a regular timestamp line, with or without a speaker in front | 120-second window, labelled [MM:SS–MM:SS] plus the meeting title |
successive turns packed to the budget |
Slides — <!-- Slide number: N --> markers |
one slide | the slide, split only if over budget |
| Headings — two or more ATX headings (specs, instructions, spreadsheets) | heading section | paragraphs and rows packed to the budget, each carrying the heading breadcrumb |
| Anything else | one structural block | the block, packed to the budget |
Detection fails safe: anything that does not clearly match falls to the generic path. The transcript pattern in particular was measured before being trusted — the 107 real transcripts in the corpus have 50.0%–51.7% of their non-blank lines matching it and all 452 other documents have exactly 0.0%, so the threshold sits in the middle of an empty gap rather than on a tuned edge.
A breadcrumb never takes more than a third of the budget. On a deeply nested
specification heading the full chain used to consume most of a chunk, leaving a
stub of body — and chunks that are mostly the same prefix embed to nearly the
same vector and compete for the same top-k slots. Past that share the breadcrumb
is elided from the middle, keeping the outermost heading and the innermost
ones: 1 Общие положения > … > 3.4.2 Порядок согласования. A heading with no
text of its own and no nested heading under it becomes a chunk of its own text,
since nothing else would carry its words into the index.
Sections are capped at 4,000 characters, because a section is what comes back in a response: a section over the cap is cut at paragraph boundaries, or at row boundaries with the header row repeated when it is a table, or at sentence boundaries when it is one unbroken paragraph. The cap is soft in exactly one place — a single table row or sentence longer than 4,000 characters on its own is left whole rather than cut into something unreadable. Measured over the corpus: 12,508 sections, median 1,182 characters, 99th percentile 3,967, and 32 sections (0.26%) over the cap, the largest of them a single 21 KB Word table cell.
Two rules hold everywhere. A markdown table breaks between rows, never inside one, and its header row is repeated in every chunk built from it, so a row chunk still says what its columns mean; a single row longer than the whole budget is split at whitespace as a last resort, and even then the parent section holds it intact. A table header row with no data rows under it is the content, and is kept as an ordinary row rather than discarded as a header with nothing to head.
And a fenced code block is atomic — the one thing allowed to exceed the
budget, because code split mid-block is wrong rather than merely partial. That
exception is bounded at both ends. It requires a genuine fence, with a closing
marker, so one stray ``` line cannot make the rest of a document indivisible;
and it stops at four budgets, past which the block is split at line boundaries
after all and every piece carries [code block split to fit the token budget].
The encoder has seen the same first 128 tokens either way, so past that point
keeping the block whole buys no retrieval quality and only inflates every
response that returns it.
Measured against the previous scheme on the same 558 documents: 64,697 chunks against 50,575, none of them over the 128-token ceiling (14.7% were), median chunk 94 tokens against 50, and ingest 1.7× faster despite the extra chunks — the deleted semantic merge stage was one of two embedding passes per document. Of five benchmark queries, three keep their top-ranked document; the two that change now rank first the document whose title names the query subject, where the old index returned a transcript fragment.
Changing the scheme requires a re-sync, and that is detected rather than
assumed: every chunk records the scheme it was cut with, and status reports
staleChunkCount plus a schemeWarning while any chunk from an older scheme
remains. A stale index answers queries perfectly happily — nothing else would
ever mention that its vectors describe truncated text.
MCP Tools
11 tools, all backed by the same index:
| Tool | Purpose |
|---|---|
sync_start |
Reconcile the index with the document roots (or one path inside them). Returns a jobId; the work runs in a background thread. |
sync_status |
Poll a sync job started by sync_start. |
ingest_file |
Ingest or re-ingest one file, replacing any content already indexed for it. |
ingest_data |
Ingest text/markdown/html content the client holds, under a source id you choose. |
ingest_url |
Fetch an http(s) URL, convert it to Markdown, and index it. |
query_documents |
Hybrid search: semantic similarity plus a keyword boost for exact terms. Each hit carries text (the passage that matched) and parentId; the enclosing sections come back once each in the response's parents map — see Chunking. |
read_chunk_neighbors |
Read the chunks immediately before and after a search result, for context. |
read_file |
Read a source's entire indexed content as Markdown, reconstructed from its chunks rather than concatenated from them. |
list_files |
List files found on disk under the document roots, plus indexed data/url sources. |
delete_file |
Delete an indexed file, data item, or url item from the index. |
status |
Report configuration and index status, including whether the index predates the current chunking scheme. Works even when configuration is invalid. |
MCP tool file paths (filePath) must be absolute and inside a configured
document root.
CLI
minirag-mcp with no arguments starts the MCP server on stdio; a subcommand
runs a one-shot CLI action against the same index instead.
Every subcommand accepts the same option quartet, given after the
subcommand, plus --json for machine-readable output:
| Flag (repeatable where noted) | Env var equivalent | Effect |
|---|---|---|
--base-dir (repeatable) |
BASE_DIR / BASE_DIRS |
Document root(s); overrides the env vars entirely when given. |
--db-path |
DB_PATH |
Index directory. |
--cache-dir |
CACHE_DIR |
Embedding model cache directory. |
--model-name |
MODEL_NAME |
fastembed model id. |
CLI-relative paths (for ingest, read, delete, --file-path, ...)
resolve against the current directory, unlike MCP tool paths, which must be
absolute. With no --base-dir/BASE_DIR/BASE_DIRS, the document root
defaults to the current directory.
# Index everything under a folder (recursive; also accepts individual files)
minirag-mcp ingest ~/docs
# Reconcile the index with what's on disk: ingest new/changed files,
# skip unchanged ones, drop entries for files that were deleted
minirag-mcp sync
# Fetch and index a web page
minirag-mcp ingest-url https://example.com/release-notes --source release-notes
# Hybrid search
minirag-mcp query "connection timeout error" --top-k 5
# Search only under one subtree
minirag-mcp query "changelog" --scope ~/docs/releases
# Read the chunks around a known hit, for context
minirag-mcp read-neighbors --file-path ~/docs/notes.md --chunk-index 3 --before 2 --after 2
# Read a whole indexed document back as Markdown
minirag-mcp read ~/docs/notes.md
minirag-mcp read --source release-notes # for data/url sources
# List every file under the roots with its ingestion state
minirag-mcp list
# Config + index health, as JSON
minirag-mcp status --json
# Remove a file from the index (the file itself is untouched on disk)
minirag-mcp delete ~/docs/old-notes.md
The 9 subcommands: ingest, ingest-url, sync, query, read-neighbors,
read, list, status, delete.
Each subcommand's --json output carries the same fields as the matching MCP
tool. Exit status is 0 on success and 1 on failure; ingest and sync
both count any per-file failure as a failure of the run, while still printing
the full counts and a warn: line per file. The one exception is status,
which is the command you reach for when the configuration is broken: on a
configuration error it reports {version, configError} and exits 0, exactly
like the status MCP tool. Every other command exits 1 on the same error.
Search Tuning
Four environment variables shape query_documents/minirag-mcp query
results; none of them are exposed as MCP tool arguments.
topK (--top-k on the CLI) must be at least 1 and is capped at 100.
Search fetches a multiple of topK candidates from each of the vector and
keyword sides, so an unbounded topK is an unbounded scan. A larger value is
clamped to the cap rather than rejected — asking for too much context is a bad
guess, not an error — while 0 or a negative value is refused outright.
RAG_HYBRID_WEIGHT (default 0.6, range 0.0–1.0)
query_documents runs a vector search and a BM25 full-text search in
parallel, then fuses the two ranked lists with weighted Reciprocal Rank
Fusion (RRF): for each candidate, `score = (1 − weight) / (k + vector_rank
-
-
- weight / (k + keyword_rank + 1)
, whereweightisRAG_HYBRID_WEIGHTandk = 60` is the standard RRF damping constant.
- weight / (k + keyword_rank + 1)
-
Fusing by rank position rather than blending raw scores is deliberate: L2
vector distance and BM25 relevance live on incomparable scales, so a
raw-score blend (or LanceDB's built-in LinearCombinationReranker, which
was tried first) lets a strong vector match bury an exact keyword hit no
matter how the weight is tuned. RRF sidesteps the scale mismatch entirely by
only looking at each side's ranking.
0.0— pure vector search (keyword ranking ignored, FTS isn't even run).1.0— pure keyword ranking (BM25 order wins ties completely).0.6(default) — leans slightly toward exact-term matches while still benefiting from semantic recall.
Titles and filenames. The BM25 side indexes the title column as well as
the chunk text, so a query matching a document's title finds it even when the
term never appears in the body. For files the title is chosen as: converter
metadata (only formats like HTML and EPUB carry it) → the first # H1, unless
it is boilerplate → the filename stem, when it is informative → the
first # H1 → the stem.
A heading the author wrote is the best title available, so it wins by default.
It steps aside when it names a section rather than the document — office
document sets share their opening section ("1. Общие положения", "Лист
изменений", "Introduction", "Table of contents"), so that heading is identical
across the whole set — or when it holds no words at all, as a heading that is
only a picture does. Then the filename takes over: a stem is informative
unless it is shorter than 4 characters or, once pure-digit tokens are dropped,
consists only of generic words (untitled, document, new, copy, scan,
img, dsc, screenshot, копия, документ, …). That rejects the names
machines hand out — Untitled-1, IMG_20260807_123456, Копия документа (2) — while keeping real names that merely contain such a word. Underscores
become spaces and the rest is kept as-is, so И-112_ЗПС_Хранение ТМЗ.docx
gives the title И-112 ЗПС Хранение ТМЗ.
The title is also prepended as a # Title line to the first chunk's text
before embedding, so it reaches semantic search too — later chunks are
untouched, and chunk boundaries, ids and counts are unaffected. A chunk that
already carries the title is left alone, which keeps re-ingest idempotent and
keeps chunk 0 looking like its siblings, so its section still reconstructs. Data and URL
sources are seeded only when they have a title of their own (given explicitly
or found in the content): a source id or a bare URL identifies a document
without describing it, and injecting it would only add noise to the vector.
Both are ingest-time decisions: already-indexed files keep the title they
were ingested with until they are re-ingested. sync will not do it for
you — it treats a file whose content hash is unchanged as already ingested —
so use ingest_file per file, or delete_file and re-sync. Keyword search
over the title column, by contrast, needs no re-ingest: an index built by an
earlier version gains the title index the next time it is opened. That upgrade
is best-effort — a read-only index directory, or a second process racing for
the same commit, leaves the index as it was and warns instead of failing, so
the database still opens and still searches (titles simply stay out of keyword
results until an index can be built).
Hits without a distance. The vector side only fetches a bounded window of
candidates, so at any weight above 0.0 the keyword side can surface a chunk
the vector side never scored. Such a hit is returned with distance: null —
it was ranked by BM25 alone. The two distance-based settings below each say
explicitly what they do with those hits, because "no distance" cannot be
compared against a distance threshold.
RAG_GROUPING (unset by default; similar or related)
Cuts the result list at a natural relevance boundary instead of returning a
fixed topK. A boundary is any gap between two consecutive distances — taken
over the results sorted by distance, ascending — that exceeds the mean
gap across the whole list by a factor of 2. This ignores small jitter and
only reacts to a materially significant jump in relevance.
similar— keep only the first relevance group (everything before the first boundary).related— keep up to two relevance groups (everything before the second boundary, if one exists).- Unset — no grouping; return up to
topKresults regardless of gaps.
Only results that have a distance are judged, and at least 3 of them are needed for a boundary to exist at all. Hits without a distance are kept unconditionally — a distance-gap rule has nothing to measure them by. Surviving results keep their fused-rank order; grouping changes which results come back, never the order they come back in.
RAG_MAX_DISTANCE (unset by default)
Drops results whose vector distance exceeds this value. Distance is
LanceDB's raw metric distance for the table (lower is more similar); it is
not normalized to 0.0–1.0. Run a query without this set first to see the
distance range typical for your corpus and embedding model before picking a
cutoff.
Setting this also drops every hit without a distance: you asked for results within a distance bound, and a chunk that was never scored by the vector side cannot be shown to satisfy one. Expect a keyword-heavy query to return fewer results with this set than without it, beyond the ones actually filtered by distance.
RAG_MAX_FILES (unset by default)
Keeps chunks only from the first N distinct source files encountered in rank order, so results don't get dominated by one large, highly-relevant document.
Configuration
All of these are environment variables, each overridable per-command by the
CLI's --base-dir/--db-path/--cache-dir/--model-name flags. Root
resolution order is: CLI --base-dir (repeatable) > BASE_DIRS > BASE_DIR
current directory — each level fully replaces the ones below it, never merges with them.
| Env var | Default | Description |
|---|---|---|
BASE_DIR |
current directory | One document root; also the security boundary for file access. |
BASE_DIRS |
unset | JSON array of document roots, e.g. ["/docs/a", "/docs/b"]. Takes precedence over BASE_DIR. An invalid value is a hard configuration error — status still answers and reports it, every other tool fails until it's fixed. |
DB_PATH |
<first root>/.minirag/lancedb |
LanceDB directory. Lives next to the documents by default so each corpus gets its own index; set explicitly to share one index root elsewhere. |
CACHE_DIR |
platformdirs user cache dir, e.g. ~/Library/Caches/minirag-mcp/models on macOS |
Embedding model cache. Global by default so the ~220 MB model is downloaded once and shared across every corpus, not duplicated per project. |
MODEL_NAME |
sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 |
fastembed model id. Changing this makes existing vectors incompatible with new queries (different model, different embedding space — even a same-dimension model isn't comparable) — pair a MODEL_NAME change with a new DB_PATH or a full re-ingest. |
MAX_FILE_SIZE |
104857600 (100 MB) |
Per-file size limit, enforced before parsing. |
CHUNK_TOKEN_BUDGET |
110 |
Retrieval-unit size, in the embedding model's own tokens. Range 16–128; the upper bound is the model's trained sequence length, past which the encoder does not see the text at all. See Chunking. |
RAG_HYBRID_WEIGHT |
0.6 |
See Search Tuning. |
RAG_GROUPING |
unset | See Search Tuning. |
RAG_MAX_DISTANCE |
unset | See Search Tuning. |
RAG_MAX_FILES |
unset | See Search Tuning. |
ALLOW_PRIVATE_URLS |
unset (off) | Let ingest_url fetch hosts that resolve to loopback, link-local, private, reserved, or unspecified addresses. Off by default — see Security and Operation. Accepts 1/true/yes/on and 0/false/no/off; anything else is a configuration error. |
Security and Operation
- Every file operation resolves the real path — symlinks followed — and requires containment inside a configured document root; a symlink or path that escapes the root(s) is rejected with a clear error, not silently followed.
- The same containment rule applies to scanning, so
sync/sync_start,ingest <dir>, andlistcannot pull in a file the roots don't contain. A symlink inside a root whose target escapes every root is skipped silently — it isn't an error, it simply isn't part of the corpus. (This matters because the extension whitelist matches the link's name while the parser reads the target: without the check, anotes.mdpointing at~/.ssh/id_rsawould be indexed and returned by search.) Symlinks pointing to files that stay inside a root are followed and indexed as normal, under the link's path. - MCP tool file paths must be absolute. The CLI accepts relative paths and resolves them against the current directory.
scope(onquery_documentsandlist_files, and--scopeon the CLI) narrows results to a path and everything under it. Matching stops at a path separator, so/docs/projcovers/docs/proj/notes.mdbut never/docs/project-secret/notes.md. The same rule covers data and url source ids, with/as the separator: a scope ofhttps://example.com/docsmatcheshttps://example.com/docs/pageand nothttps://example.com/docs-private.MAX_FILE_SIZEis enforced before a file is parsed.ingest_urlaccepts onlyhttp/httpsURLs.file:anddata:schemes are rejected —markitdown'sconvert_uriwould otherwise read arbitrary local files, bypassing the document-root boundary entirely.ingest_urlalso checks the host, not just the scheme: a host that is, or resolves to, a loopback, link-local, private, reserved, or unspecified address is refused. That covers cloud instance metadata (http://169.254.169.254/latest/meta-data/), services bound to localhost (http://localhost:8080/admin), and anything on the LAN. The URL is usually chosen by an LLM which may be acting on text from an already-indexed document, so without this an attacker-authored document is a prompt-injection path into your network. A name is rejected if any of its addresses is blocked, and the error names the host and the reason. A host that simply fails to resolve is reported as a fetch error, not a security refusal.- The host check runs again on every redirect hop, not just on the URL you
supplied. Checking only the given URL leaves the fetch itself open: a
permitted public host answering
302 -> http://169.254.169.254/would have had its redirect followed and the metadata response indexed. The check sits in the HTTP transport, which sees each hop, and the chain is capped at 5 redirects (requestswould follow 30). A refusal names the blocked host and says the fetch was redirected there. - Set
ALLOW_PRIVATE_URLS=1to turn the host check off — for a server you point at an internal wiki on purpose. It applies to redirect hops as well as to the URL you supply, and changes nothing else:file:anddata:are still rejected. - Known gap: DNS rebinding. The check resolves the host itself, and then
requestsresolves it again when it opens the connection — two independent lookups, so a name with a short TTL can answer with a public address for the check and a private one for the fetch. Closing that means pinning the validated address at the socket layer, which this server does not do. Read the host rule accordingly: it stops accidental and injection-driven access to obvious internal targets, and it is not a defence against an attacker who controls DNS for a name you ask the server to ingest. - No other network I/O happens: only an explicit
ingest_urlcall and the one-time embedding-model download ever leave the machine. - Single local user, no authentication. Concurrent writers against one
DB_PATHare safe — LanceDB commits optimistically and retries, so parallel ingests lose no rows and the state they settle on is always correct. What a reader can catch is a source mid-replacement: re-indexing deletes the old chunks before writing the new ones, so a query timed badly enough may see that one source with only some of its chunks, or none — one more reason two syncs at once are undesirable. Two syncs are also simply wasteful, since both re-walk and re-index the same corpus, sosync/sync_starttakes an advisory lock on<DB_PATH>/.sync.lockand a second one refuses immediately, naming the process that holds it and how long it has been running. Single-file ingests and reads are never blocked, and the lock is released by the kernel if a sync is killed, so it can't go stale. - Re-indexing a source replaces its chunks by deleting the old ones and
writing the new ones, so a sync interrupted mid-file (Ctrl-C, a crash, a
server restart) can leave that one source temporarily absent from the
index while its file is still on disk. This is self-healing: the next
sync/sync_startsees the file as not indexed and re-ingests it. Nothing on disk is ever modified, and no other source is affected. - Backup: copy the
DB_PATHdirectory while no writer (an ingest or sync) is active.
Troubleshooting
"No results found" / empty results.
Nothing has been indexed yet, or your query's scope excludes everything
that matches. Run sync_start (or minirag-mcp sync) first, then confirm
with status or list_files that chunkCount/sourceCount are non-zero.
status reports staleChunkCount above zero.
Those chunks were cut by an older chunking scheme: their boundaries follow the
old rules and their vectors were computed over text the embedding model
truncated, so they rank against today's queries as something other than what
they say. Re-sync to rebuild them — sync_start, or minirag-mcp sync. A sync
normally skips a file whose bytes are unchanged, but a source cut by an older
scheme is re-ingested anyway: the file has not changed, what it was cut into
has. Searching still works in the meantime; it is simply searching text the
model only half saw.
Model download fails on first use.
The first ingestion downloads ~220 MB from Hugging Face via fastembed; a
flaky connection or a corporate proxy can interrupt it. Check connectivity,
then retry — if a partial download left the cache in a bad state, delete
CACHE_DIR (see Configuration for its default location)
and retry.
"... exceeds MAX_FILE_SIZE" / "file too large".
The file is bigger than the 100 MB default limit. Raise it:
export MAX_FILE_SIZE=209715200 (200 MB), or exclude the file.
"Refusing to fetch from host ..." / "... it redirected to ...".
ingest_url was pointed at — or redirected to — a host that is, or resolves
to, a private or local address. If that is deliberate — an internal wiki, a
service on this machine — set ALLOW_PRIVATE_URLS=1. If it is not, treat the
URL as untrusted: it may have come from a document in the index rather than
from you. A refusal that names a host you never typed means the page you asked
for redirected there.
"Path outside configured document roots".
The path (or what a symlink resolves to) isn't inside any configured root.
Check status for the active roots, and remember MCP tool paths must be
absolute.
"BASE_DIRS must be a JSON array of ... path strings".
BASE_DIRS needs valid JSON — an array of one or more non-empty path
strings: export BASE_DIRS='["/docs/a", "/docs/b"]'. status keeps working
even with a broken BASE_DIRS; every other tool fails until it's fixed.
MCP client doesn't show the tools.
- Run the same command the client runs (
uvx minirag-mcp) directly in a terminal — it should hang silently, waiting on stdio (Ctrl-C to exit). If that fails, the client will fail the same way. - Restart the client after adding or editing the server config.
- Confirm
uv/uvxis on thePATHthe client's process sees — GUI apps sometimes launch with a differentPATHthan your shell. - Run
minirag-mcp status --base-dir <root>from a terminal to confirm the configuration resolves the way you expect.
Releasing
Maintainers only. Releases reach PyPI through trusted publishing: the workflow mints a short-lived OIDC token for the upload, so there is no PyPI API token in the repository secrets, in the workflow, or on anyone's laptop.
The workflow has to land on main before any tag is cut. GitHub fires the
release event only for a workflow file that exists on the default branch,
and the run it starts is pinned to the tagged commit (GITHUB_SHA is "last
commit in the tagged release"). Tag a commit that predates
release.yml reaching main and publishing
the release is a silent no-op — no run is queued, nothing turns red, and the
release simply sits there looking like a build that hung.
-
Bump, commit and tag in one step, from a clean tree on
main:uv run bump-my-version bump patch # or: minor | major
This rewrites
versioninpyproject.toml, commits that aschore: release vX.Y.Z, and creates thevX.Y.Ztag — the spellingrelease.yml's version check expects. It deliberately does not push: everything so far is local and reversible. Add--dry-run --verboseto see exactly what it would do first.versioninpyproject.tomlis the only place the number lives.__version__— what thestatustool andminirag-mcp --versionreport — is read from the installed distribution's metadata, so it cannot drift from what was packaged. -
Push the commit and the tag:
git push && git push origin vX.Y.Z. -
Publish a GitHub release for that tag.
Publishing the release runs release.yml. It runs ruff and pytest first —
ci.yml has no tag trigger, so a tag is the one ref CI never covers and this
is the only thing standing between an untested commit and PyPI — then builds
the sdist and wheel, smoke-tests the wheel in a clean venv, and checks the
built version against the tag. That last check is unconditional and ref-based:
a mismatch fails the build, and so does any attempt to publish from a branch
ref, since a branch carries no version to check a build against.
twine check --strict also runs, but read it narrowly: it validates the
distribution metadata and catches an empty long description, and it does not
validate this project's Markdown README, because readme_renderer only
understands reStructuredText.
Only then does a separate job upload to PyPI. That job runs in the pypi
environment, which restricts deployments to v* tags. It has no required
reviewer — adding one under Settings → Environments → pypi is a one-click
change that would turn the upload into a manual approval step, but as
configured today the gate is the ref restriction, not a human.
If a publish fails after the release already exists, use GitHub's Re-run
failed jobs on the original release run: that replays the same release
event, so every guard above still applies. workflow_dispatch is the fallback
and only works when the ref you select is the tag — a dispatch from a branch is
refused. Uploads are idempotent (skip-existing: true), so retrying after a
partial upload finishes the remaining files instead of dying on "File already
exists".
License
MIT — see LICENSE.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file minirag_mcp-0.2.0.tar.gz.
File metadata
- Download URL: minirag_mcp-0.2.0.tar.gz
- Upload date:
- Size: 358.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7de3a2c0c5fc2d5953aef8b873b3665305c54b892ffcc524a515e39548952d19
|
|
| MD5 |
103ac9a5caa75e487e46c1a5a1ba6b74
|
|
| BLAKE2b-256 |
a0def47eb8e88281d08fadd0a29745b9dca7c0df6d546c1f3e012b5e663c8414
|
Provenance
The following attestation bundles were made for minirag_mcp-0.2.0.tar.gz:
Publisher:
release.yml on sfrangulov/minirag-mcp
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
minirag_mcp-0.2.0.tar.gz -
Subject digest:
7de3a2c0c5fc2d5953aef8b873b3665305c54b892ffcc524a515e39548952d19 - Sigstore transparency entry: 2385285227
- Sigstore integration time:
-
Permalink:
sfrangulov/minirag-mcp@a57dcb22a49074ff817f7efc9ebcaadb26e4570c -
Branch / Tag:
refs/tags/v0.2.0 - Owner: https://github.com/sfrangulov
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@a57dcb22a49074ff817f7efc9ebcaadb26e4570c -
Trigger Event:
release
-
Statement type:
File details
Details for the file minirag_mcp-0.2.0-py3-none-any.whl.
File metadata
- Download URL: minirag_mcp-0.2.0-py3-none-any.whl
- Upload date:
- Size: 84.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9c0edd33cdae9e586e95208896914fb15e8b940a6720d15dcad6a94639addc32
|
|
| MD5 |
56ee6535da9019cf7c008d2ddc0d7f31
|
|
| BLAKE2b-256 |
e93ae05627bb16b0ab4d9b25ae57a57ac940c302bcd522d672e6370ba8f6ac63
|
Provenance
The following attestation bundles were made for minirag_mcp-0.2.0-py3-none-any.whl:
Publisher:
release.yml on sfrangulov/minirag-mcp
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
minirag_mcp-0.2.0-py3-none-any.whl -
Subject digest:
9c0edd33cdae9e586e95208896914fb15e8b940a6720d15dcad6a94639addc32 - Sigstore transparency entry: 2385285271
- Sigstore integration time:
-
Permalink:
sfrangulov/minirag-mcp@a57dcb22a49074ff817f7efc9ebcaadb26e4570c -
Branch / Tag:
refs/tags/v0.2.0 - Owner: https://github.com/sfrangulov
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@a57dcb22a49074ff817f7efc9ebcaadb26e4570c -
Trigger Event:
release
-
Statement type: