make-localllm-easier — run the best local LLM your GPU can handle, in one command

Read this in: English | தமிழ்

localllm checks your GPU, picks the most accurate AI model that fits it in your language, downloads it and starts a private chat. Offline and free.

Install

pip install make-localllm-easier
localllm

That's it: the first run shows what your PC can run and asks before it downloads the model. No Python yet? Single-file downloads for Windows, macOS and Linux are coming with the next release (packaging/README.md).

The commands you'll use

localllm            # pick, download and start the best model, open the chat page
localllm chat       # chat in the terminal, any language
localllm doctor     # what this GPU can run: model sizes, speed, RAM
localllm serve      # just the API: OpenAI, Anthropic, Ollama and Gemini formats at http://127.0.0.1:8080

More: localllm list (every measured model), localllm connect hermes (point an agent or Obsidian at it), localllm eval (score any server in your language). All commands: localllm --help.

Why it's different

• It picks for your GPU. It reads your card and RAM and only offers models that fit and run fast on them.
• Measured in your language. Models are ranked by real exam scores in Thai, Hindi, Arabic, Japanese and 20+ more languages, not by English benchmarks alone.
• Uses less RAM. llama.cpp tuned op by op: about 4x less system RAM than its defaults, same speed (below).
• Private. After the first download nothing leaves your PC; downloads are checked against pinned SHA-256s.

Less RAM, same speed

Same 30-turn chat, RX 9070 XT, 32 GB RAM:

Learn more

Website and leaderboard · FAQ · How it works (doctor output, routing, RAM, where it's tested) · APIs and agents · Benchmarks · Research · Roadmap · Stability · Contributing

Have a GPU we haven't measured? localllm tune, localllm eval --langs en,<yours>, then localllm report opens a prefilled issue (no names, paths or keys) that adds it to the leaderboard.

License

MIT. Models keep their own licenses; benchmark data keeps its own (Apache-2.0).