This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 1.35.1 instead.
Galahad-KV
Long-term memory for AI models — a KV-cache layer for vLLM and SGLang.
Galahad keeps the KV cache your model already computed, encrypted on disk, and gives it back on the next run — so a long prompt, a document, or a conversation is remembered across requests and across restarts instead of being recomputed every time. It installs with one command and the serving engine finds it automatically.
pip install galahad-kv
Linux x86-64, Python 3.10–3.14. libgalahad.so ships inside the wheel — no
compiler, no build step.
Beta. Galahad-KV is launching as a beta with paid pilots. It is in active use and tested on vLLM and SGLang; limits are stated plainly and are being improved through pilots.
Quick start
Every install needs a licence — it is also the encryption key for your stored memory, and it never leaves your machine.
# 1. a free licence (one GPU, non-commercial, 12 months) — or `galahad buy` for more
galahad free --org your-org-key --email you@company.com --accept-non-commercial
# 2. check everything is ready
galahad doctor
Then activate it in whichever way you serve:
vLLM
export GALAHAD_CACHE_DIR=/var/galahad
vllm serve <model> \
--kv-transfer-config '{"kv_connector":"GalahadConnector","kv_role":"kv_both"}'
vLLM discovers the connector by itself — no module path, no PYTHONPATH.
SGLang
export GALAHAD_CACHE_DIR=/var/galahad
python -m sglang.launch_server --model-path <model> \
--enable-hierarchical-cache --hicache-ratio 1.5 --hicache-storage-backend dynamic \
--hicache-storage-backend-extra-config \
'{"backend_name":"galahad","module_path":"galahad_vllm.sglang_backend","class_name":"GalahadHiCacheStorage"}'
Your own code (bare)
Link libgalahad.so and call its C ABI directly; the licence supplies the key.
See the wiki for the five-minute check.
The galahad command
pip install galahad-kv gives you one command for everything:
| command | what it does |
|---|---|
galahad help |
activation for vLLM / SGLang / bare, in one place |
galahad doctor |
health check — library loads? licence valid? store writable? |
galahad free |
a free licence (one GPU, non-commercial) |
galahad buy |
a paid licence (more GPUs / commercial) — opens checkout |
galahad quote |
volume or custom terms |
galahad status |
is a licence installed and enforcing? |
galahad points |
how many GPU-points this machine is (pricing) |
galahad version |
library, ABI, engine and transport |
What you get
- Memory that survives restarts. What was remembered on one run is available on the next, without recomputing it.
- Encrypted at rest. Your stored memory is encrypted. By default your licence unlocks it; nothing extra to manage.
- Your key stays yours. Optionally hold your own key via
GALAHAD_STORE_PASSPHRASE— it stays on your machine and is never sent to us. Lose it, lose the memory; that is the point. - One install, both engines. The same wheel works with vLLM and SGLang.
- No surprises without a licence. Without one, it will not quietly do nothing — it tells you.
Known limits (beta, stated plainly)
- One serving process = one trust domain. Do not put mutually-untrusted users behind one server; run separate processes, stores and keys per customer.
- Version pins. vLLM 0.30, SGLang 0.5.20, matching transformers. Newer engine versions change internal APIs the connector binds to.
- Linux only (manylinux_2_28, glibc ≥ 2.27), Python 3.10–3.14.
Links
- Documentation & guides: the project wiki
- Issues & contact: see the project page
© 2026 Corbenic AI — Sietse Schelpe. All rights reserved. Galahad-KV is proprietary software; see the licence terms delivered with your key. Author: Sietse Schelpe — Corbenic AI.
Metadata
Release files for galahad-kv 1.31.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 64.6 MB
Release files / galahad_kv-1.31.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | galahad_kv-1.31.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.14 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
dea7909694972e408deffd88bb7cf774d723fec139eda355884e9bb99272db7e
|
|
BLAKE2b-256 checksum How to use checksums |
3df3512006ced0752a7246f0ad08be27ac7bea48d925a2df6bc4578c46f602a2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / galahad_kv-1.31.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | galahad_kv-1.31.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.13 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
2f017b5f7b22ac3e0640623232a24460067419cd3dbeb14e9e0bbd77e452c8ef
|
|
BLAKE2b-256 checksum How to use checksums |
d04c53a38a04fd9db3ec8435d7161d80f2e9a281a084cd0594656bd8628a3c52
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / galahad_kv-1.31.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | galahad_kv-1.31.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.12 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
fc526c6d2f82999a6660b0a64df46ed12ee565ea22ed840cf1f1762d17c80d2f
|
|
BLAKE2b-256 checksum How to use checksums |
97285462cb23b30d8a1ae1aeeda8c2894c2c72acaccbaa8700071145ee2907e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / galahad_kv-1.31.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | galahad_kv-1.31.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.11 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
c385a179ca9b3042cb2f49a7e41e8d1ebf3528343a63aea8b948cef5c398cd1c
|
|
BLAKE2b-256 checksum How to use checksums |
d6c7a984b06d3f40a2716ce8fcf0809c5bb7a7f74ccfeee4d0cb68e3a5066ed0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / galahad_kv-1.31.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | galahad_kv-1.31.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.10 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
decd70ce5bfe98d870380da4ba8bf7b71dbb34ac0559fb8fbc2c746aa91703ff
|
|
BLAKE2b-256 checksum How to use checksums |
b294dd05379326f15660cc3735cd2f2cd2f347144d966ba3fc4cfbcec36a5435
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Security for galahad-kv 1.31.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.