ggk
One package for working with GGUF models locally: an OpenAI-compatible LLM server, a diffusion image/video/audio generator and a GGUF metadata/tensor editor with a built-in quantizer — three panels on one GUI, powered by one unified engine compiled in a single build on top of gk, an independent tensor library. There is no ggml anywhere in the tree.
Install
pip install ggk
The build compiles the bundled engine (CPU by default, Metal on macOS). GPU backends are opt-in at install time:
GGK_CUDA=1 pip install ggk # NVIDIA
GGK_HIP=1 pip install ggk # AMD ROCm
GGK_VULKAN=1 pip install ggk # Vulkan
Each switch drives the whole engine — the server, the diffusion runtime and the multimodal projectors all evaluate their graphs on the one gk build.
Run
ggk # unified GUI — Server / Diffuser / Editor panels
python -m ggk # same thing
Each panel also runs on its own, exactly like the standalone gguf-server / gguf-diffusion / gguf-editor packages did:
ggk server # LLM server GUI
ggk diffuser # image generation GUI
ggk editor # GGUF editor GUI
And the engines are directly scriptable from the CLI:
ggk server engine -- --model model.gguf --port 8888
ggk diffuser engine -- -m sd.gguf -p "a lighthouse at dusk" -o out.png
ggk editor quantize -m in.gguf -o out-q4_k.gguf --type q4_k
ggk editor devices
Layout
vendor/engine/ the unified ggk engine (one CMake build)
gk/ the gk compute kernels (CPU + optional GPU backends)
gk/compat/ the historical ggml C API, implemented on gk
src/ common/ mtmd/ GGUF LLM runtime
app/ the gguf-server HTTP server
diffusion/ diffusion runtime + CLI
quantizer/ quantizer shared library (its own quant kernels)
src/ggk/ the Python package
server/ diffuser/ editor/ the three panels (backend + web frontend each)
gui.py static/ the unified 3-panel GUI shell
Nothing above gk/compat/ knows gk exists: the runtimes include the same
ggml.h / ggml-backend.h / gguf.h headers and call the same functions
they always did, while graph building, allocation, scheduling and the kernels
themselves are gk's. See vendor/engine/README.md for the engine's own build
options.
The editor's quantizer stays independent — its qz_* codec is compiled both
into the quantizer library the editor drives and into gk itself, so the
encoder and the runtimes' decoder can never disagree about a GGUF block.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ggk-0.0.3.tar.gz.
File metadata
- Download URL: ggk-0.0.3.tar.gz
- Upload date:
- Size: 35.8 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a511c6cfa04a1ca9b709d891ed68831f3513551ca3b9ebaf6c52e2c9c80c7573
|
|
| MD5 |
fdabefe5359de469e8502271cd345e33
|
|
| BLAKE2b-256 |
269e377b78dedcf2a999d93cb140ca9d69822f4230f6f9c4bc557206046f7463
|
File details
Details for the file ggk-0.0.3-py3-none-win_amd64.whl.
File metadata
- Download URL: ggk-0.0.3-py3-none-win_amd64.whl
- Upload date:
- Size: 37.4 MB
- Tags: Python 3, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
df908eaebcc4e6c160a93dd4883619727e948ef49f287bd9870c64bc8425674c
|
|
| MD5 |
b25a1dc3c72c0c1a6a4de0cd81ea5c68
|
|
| BLAKE2b-256 |
c76db33a05490e06e0ea598c13cb363839d85ec67a9a0f46ed152f828edac071
|
