Privacy-first RAG CLI — local LLM + SearXNG, zero cloud, zero Docker
Project description
TiniRAG
Privacy-first RAG CLI — local LLM + SearXNG, zero cloud, zero Docker.
Install
pip install tinirag # or: pipx install tinirag
Usage
tinirag "what is Python asyncio?"
tinirag --no-search "explain transformers" # skip web search
tinirag -m llama3.2:3b "hello" # override model
tinirag chat # interactive REPL
tinirag setup # guided first-run wizard
tinirag status # show Ollama + SearXNG health
Features
- Auto-detects your installed Ollama models — no need to configure a model name; TiniRAG picks the best available one automatically (prefers instruct/chat-tuned, smallest ≥ 3b parameters)
- Privacy-first: no cloud APIs, everything runs locally
- SearXNG web search (optional) for grounded, real-time answers
- Streaming output, session memory, guardrails
Enable web search (optional)
SearXNG is not required but improves answer quality with live web results.
pipx inject tinirag searxng # if installed via pipx
# or:
pip install searxng # if installed via pip
Then run any query — TiniRAG auto-starts SearXNG on port 18888.
Requirements
- Python 3.11+
- Ollama running locally (
ollama serve) - At least one model pulled:
ollama pull llama3.2:3b
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tinirag-0.3.1.tar.gz
(27.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
tinirag-0.3.1-py3-none-any.whl
(34.4 kB
view details)
File details
Details for the file tinirag-0.3.1.tar.gz.
File metadata
- Download URL: tinirag-0.3.1.tar.gz
- Upload date:
- Size: 27.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5c73284ab938d289c13ff44581987a8448bcefaceac2a17fe6d2d65979a718ec
|
|
| MD5 |
231d9dd0fd09e46e772ddcea1c0abeed
|
|
| BLAKE2b-256 |
3e7a79cda0f4501ee7c14333cb3e6991aa1efaab4aac5ff6f94249bf886c724e
|
File details
Details for the file tinirag-0.3.1-py3-none-any.whl.
File metadata
- Download URL: tinirag-0.3.1-py3-none-any.whl
- Upload date:
- Size: 34.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2e0720b009034ad9d5356568f6d578fc2a1f108e2346dc86a2abe430714417a0
|
|
| MD5 |
26240e3f3903fca404358dffb9774dcb
|
|
| BLAKE2b-256 |
9efb3f18a649940829dcd91b3677f7a585882d428bec46b9f937e32b5e898284
|