Skip to main content

Privacy-first RAG CLI — local LLM + SearXNG, zero cloud, zero Docker

Project description

TiniRAG

Privacy-first RAG CLI — local LLM + SearXNG, zero cloud, zero Docker.

Install

pip install tinirag        # or: pipx install tinirag

Usage

tinirag "what is Python asyncio?"
tinirag --no-search "explain transformers"   # skip web search
tinirag -m llama3.2:3b "hello"              # override model
tinirag chat                                 # interactive REPL
tinirag setup                                # guided first-run wizard
tinirag status                               # show Ollama + SearXNG health

Features

  • Auto-detects your installed Ollama models — no need to configure a model name; TiniRAG picks the best available one automatically (prefers instruct/chat-tuned, smallest ≥ 3b parameters)
  • Privacy-first: no cloud APIs, everything runs locally
  • SearXNG web search (optional) for grounded, real-time answers
  • Streaming output, session memory, guardrails

Enable web search (optional)

SearXNG is not required but improves answer quality with live web results.

pipx inject tinirag searxng    # if installed via pipx
# or:
pip install searxng            # if installed via pip

Then run any query — TiniRAG auto-starts SearXNG on port 18888.

Requirements

  • Python 3.11+
  • Ollama running locally (ollama serve)
  • At least one model pulled: ollama pull llama3.2:3b

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tinirag-0.3.1.tar.gz (27.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tinirag-0.3.1-py3-none-any.whl (34.4 kB view details)

Uploaded Python 3

File details

Details for the file tinirag-0.3.1.tar.gz.

File metadata

  • Download URL: tinirag-0.3.1.tar.gz
  • Upload date:
  • Size: 27.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tinirag-0.3.1.tar.gz
Algorithm Hash digest
SHA256 5c73284ab938d289c13ff44581987a8448bcefaceac2a17fe6d2d65979a718ec
MD5 231d9dd0fd09e46e772ddcea1c0abeed
BLAKE2b-256 3e7a79cda0f4501ee7c14333cb3e6991aa1efaab4aac5ff6f94249bf886c724e

See more details on using hashes here.

File details

Details for the file tinirag-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: tinirag-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 34.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tinirag-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2e0720b009034ad9d5356568f6d578fc2a1f108e2346dc86a2abe430714417a0
MD5 26240e3f3903fca404358dffb9774dcb
BLAKE2b-256 9efb3f18a649940829dcd91b3677f7a585882d428bec46b9f937e32b5e898284

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page