llmfit
📊 New: benchmark & share — real numbers from your machine, better estimates for everyone. Download a model, serve it, and measure real tok/s on your hardware — then contribute the results back to the project as a PR, straight from the TUI. No
ghCLI, no third-party account. Every run is saved locally first, your own measurements replace estimates in the fit table, and each merged submission ships in the next release: anyone on identical hardware gets measured✓numbers before they ever run a benchmark. Follow the step-by-step benchmarking guide →Previously: llmfit 1.0 — the release where the numbers became verifiable →
Hundreds of models & providers. One command to find what runs on your hardware.
A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.
Ships with an interactive TUI (default) and a classic CLI mode. Supports multi-GPU setups, MoE architectures, dynamic quantization selection, speed estimation, and local runtime providers (Ollama, llama.cpp, MLX, Docker Model Runner, LM Studio).
Sister projects:
- sympozium — managing agents in Kubernetes.
- llmserve — a simple TUI for serving local LLM models. Pick a model, pick a backend, serve it.
- llama-panel — a native macOS app for managing local llama-server instances.
Documentation
| Get started | Install · Usage · How it works |
| Guides | TUI guide · Benchmarking step-by-step · CLI & automation · Runtime providers · OpenClaw integration |
| Reference | How it works (full) · Platform & GPU support · Custom models · Development |
| Project | Contributing · Alternatives · Code signing · License |
Install
Windows
scoop install llmfit
If Scoop is not installed, follow the Scoop installation guide.
macOS / Linux
Homebrew
Prebuilt binary (recommended, works on all macOS/Linux versions):
brew install AlexsJones/llmfit/llmfit
Or from the homebrew-core formula, which builds from source on macOS versions without a bottle:
brew install llmfit
MacPorts
port install llmfit
Quick install
curl -fsSL https://llmfit.axjns.dev/install.sh | sh
Downloads the latest release binary from GitHub and installs it to /usr/local/bin (or ~/.local/bin if no sudo).
Install to ~/.local/bin without sudo:
curl -fsSL https://llmfit.axjns.dev/install.sh | sh -s -- --local
uv / pip
To install or update llmfit:
uv tool install -U llmfit
To run without installing:
uvx llmfit
You can also install llmfit as a Python package in the normal way with tools such as pip or uv.
Docker / Podman
docker run ghcr.io/alexsjones/llmfit
This prints JSON from llmfit recommend command. The JSON could be further queried with jq.
podman run ghcr.io/alexsjones/llmfit recommend --use-case coding | jq '.models[].name'
To launch the interactive TUI instead, pass the global --tui flag:
docker run --rm -it ghcr.io/alexsjones/llmfit --tui
From source
git clone https://github.com/AlexsJones/llmfit.git
cd llmfit
cargo build --release
# binary is at target/release/llmfit
Usage
llmfit # interactive TUI: your hardware, every model, ranked
The TUI shows your detected specs at the top and every model scored for fit, speed, quality, and context. See the TUI guide for navigation, planning, simulation, downloads, the community leaderboard, and benchmarking.
For scripts, agents, and classic terminal output:
llmfit fit # table of all models ranked by fit
llmfit recommend --json # top picks as JSON (agent/script consumption)
llmfit info "<model>" # one model: fit analysis, estimate basis, verify commands
llmfit bench # measure real tok/s/TTFT against your running provider
llmfit doctor # hardware detection report for bug reports
Full reference: CLI & automation.
How it works
llmfit detects your hardware (RAM, CPU, GPU/VRAM, backend), then scores every model in its catalog across four dimensions: memory fit, estimated speed, quality, and context. Speed estimates come from a memory-bandwidth model grounded in runtime sampling and real community measurements — and every estimate ships its inputs, so llmfit info shows exactly what a number assumes and how to verify it on your machine.
Full detail, including the estimation formulas and the model database: How llmfit works.
Contributing
Contributions are welcome, especially new models.
Before submitting a PR
Please run cargo fmt before pushing your changes. Most CI check failures are caused by unformatted code:
cargo fmt
Guides for adding models — locally (no rebuild) or to the built-in catalog: Custom models.
Alternatives
If you're looking for a different approach, check out llm-checker -- a Node.js CLI tool with Ollama integration that can pull and benchmark models directly. It takes a more hands-on approach by actually running models on your hardware via Ollama, rather than estimating from specs. Good if you already have Ollama installed and want to test real-world performance. Note that it doesn't support MoE (Mixture-of-Experts) architectures -- all models are treated as dense, so memory estimates for models like Mixtral or DeepSeek-V3 will reflect total parameter count rather than the smaller active subset.
Code signing
llmfit's Windows release binaries are digitally signed (Authenticode) via SignPath.io, with a free code signing certificate provided by the SignPath Foundation.
Signing happens automatically in the release pipeline: only artifacts built by GitHub Actions from this repository are submitted for signing, and signing requests are approved by the project maintainer (@AlexsJones).
Code signing policy: see the SignPath Foundation code signing policy and terms.
Privacy: this program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. llmfit only contacts external services when you explicitly use the corresponding feature (e.g. model downloads, runtime provider queries, or the community leaderboard).
License
MIT
1 maintainer
Metadata
1 maintainer
Release files for llmfit 1.1.12
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| llmfit-1.1.12-py3-none-win_arm64.whl | Python 3 | none | Windows ARM64 | Details |
| llmfit-1.1.12-py3-none-win_amd64.whl | Python 3 | none | Windows x86-64 | Details |
| llmfit-1.1.12-py3-none-musllinux_1_2_x86_64.whl | Python 3 | none | Linux musl 1.2+ x86-64 | Details |
| llmfit-1.1.12-py3-none-musllinux_1_2_aarch64.whl | Python 3 | none | Linux musl 1.2+ ARM64 | Details |
| llmfit-1.1.12-py3-none-manylinux_2_39_riscv64.whl | Python 3 | none | Linux glibc 2.39+ RISC-V 64 | Details |
| llmfit-1.1.12-py3-none-manylinux_2_17_x86_64.whl | Python 3 | none | Linux glibc 2.17+ x86-64 | Details |
| llmfit-1.1.12-py3-none-manylinux_2_17_aarch64.whl | Python 3 | none | Linux glibc 2.17+ ARM64 | Details |
| llmfit-1.1.12-py3-none-macosx_11_0_arm64.whl | Python 3 | none | macOS 11.0+ ARM64 | Details |
| llmfit-1.1.12-py3-none-macosx_10_12_x86_64.whl | Python 3 | none | macOS 10.12+ x86-64 | Details |
Total release size: 55.0 MB
Release files / llmfit-1.1.12-py3-none-win_arm64.whl
| Download URL | llmfit-1.1.12-py3-none-win_arm64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | Python 3 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
01b70cef9d80d9b6781f597b12600fff4ad12e58a0c900bda311ce084f19e66b
|
|
BLAKE2b-256 checksum How to use checksums |
81211510d944b200d8ee2f620f3eaac0be9f32c41e4a28c02bb5462c6864838b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-win_amd64.whl
| Download URL | llmfit-1.1.12-py3-none-win_amd64.whl |
|---|---|
| Size | 5.5 MB |
| Tags | Python 3 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
24656219d041cde2333287c27a5c859cc932d6b17b8f0aa3d705a9cbec57b6a0
|
|
BLAKE2b-256 checksum How to use checksums |
0e4f8d9e62670b86103e6b1a365fdf326da7febfa2e2c73a54acb6b9dcf367fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-musllinux_1_2_x86_64.whl
| Download URL | llmfit-1.1.12-py3-none-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 6.7 MB |
| Tags | Linux musl 1.2+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
987fbccd7f87dd2fb48bb69b59e6e02afabab81f4abd23a01b793f619ae8bc28
|
|
BLAKE2b-256 checksum How to use checksums |
b259fe751e257a4aba012843e4cff5c74eadf5d9cc62e38e401897e00ccbd2a4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-musllinux_1_2_aarch64.whl
| Download URL | llmfit-1.1.12-py3-none-musllinux_1_2_aarch64.whl |
|---|---|
| Size | 6.5 MB |
| Tags | Linux musl 1.2+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
c1c103cbf976f0cf0355e6d388f21d42bf656d1a76ad3bd7ceaf8489d5a8011f
|
|
BLAKE2b-256 checksum How to use checksums |
af23198195a8b3e7cc9c6910a66fa04aea47f33cc96a525e696078f3b712c48c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-manylinux_2_39_riscv64.whl
| Download URL | llmfit-1.1.12-py3-none-manylinux_2_39_riscv64.whl |
|---|---|
| Size | 6.5 MB |
| Tags | Linux glibc 2.39+ RISC-V 64 Python 3 |
|
SHA-256 checksum How to use checksums |
28bc9ee8ca9492afa135aea07610635c4bf3b26e2275c7334ceaac448eb181e8
|
|
BLAKE2b-256 checksum How to use checksums |
e3e2c484253af2379b2b5464e98cc35e43272ea6a240e7870a5781210baf22f4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-manylinux_2_17_x86_64.whl
| Download URL | llmfit-1.1.12-py3-none-manylinux_2_17_x86_64.whl |
|---|---|
| Size | 6.4 MB |
| Tags | Linux glibc 2.17+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
d24daf2c4bcccc49a37a8b1ea870b017962b786fe256463f23c1952eb7b02adf
|
|
BLAKE2b-256 checksum How to use checksums |
677d107bf774c7ccd2f5a5daa5660fb1a481a871e5ca8e352a0e4bcdf9d698f1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-manylinux_2_17_aarch64.whl
| Download URL | llmfit-1.1.12-py3-none-manylinux_2_17_aarch64.whl |
|---|---|
| Size | 6.4 MB |
| Tags | Linux glibc 2.17+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
304d763bc68bc10ba1806c9892a436eedff7c49a89e71558d1d00284af50d842
|
|
BLAKE2b-256 checksum How to use checksums |
d9e9685bb7ad5862be7b6d510e41186a237b66af635efa99a9fdc36f0af6b48e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-macosx_11_0_arm64.whl
| Download URL | llmfit-1.1.12-py3-none-macosx_11_0_arm64.whl |
|---|---|
| Size | 5.9 MB |
| Tags | Python 3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
869d4543a3412e7109d08bdf6d12af4c59ebb9063e7778fd0a483b7a5b2bbd5b
|
|
BLAKE2b-256 checksum How to use checksums |
4c096292ee498030ca1e353fab07cc666f8ffb52384a3d56aac060ccdeee14d6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency logRelease files / llmfit-1.1.12-py3-none-macosx_10_12_x86_64.whl
| Download URL | llmfit-1.1.12-py3-none-macosx_10_12_x86_64.whl |
|---|---|
| Size | 6.0 MB |
| Tags | Python 3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
fc3d52ebf4966d4503cf9f45e40894b488fdbbc0a9f85d4944fc53022d70e55a
|
|
BLAKE2b-256 checksum How to use checksums |
17035ffb8a690b5bd864ffd80a3c06e3bd081e4b4580e1f7ec043419e6203fda
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Aug 28, 2026.
Transparency log
