Skip to main content

Galahad-KV

Long-term memory for AI models — a KV-cache layer for vLLM and SGLang.

Galahad keeps the KV cache your model already computed, encrypted on disk, and gives it back on the next run — so a long prompt, a document, or a conversation is remembered across requests and across restarts instead of being recomputed every time. It installs with one command and the serving engine finds it automatically.

pip install galahad-kv

Linux x86-64, Python 3.10–3.14. libgalahad.so ships inside the wheel — no compiler, no build step. (macOS / Apple Silicon is planned for a later release; not supported yet.)

Free homelab edition. This build runs free on a homelab — up to 4 consumer NVIDIA GeForce RTX GPUs — with no licence, no account, and no call home. Nothing is ever sent anywhere. Datacenter GPUs (A100 / H100 / L40S / B200 …), more than four GPUs, and multi-node / Kubernetes are a separate licensed edition.


Quick start

No licence and no sign-up. The only thing you choose is a store key — a passphrase and an org name — because your memory on disk is encrypted (AES-256-GCM). The same passphrase + org always derive the same key, on any machine, so nothing is stored by us and nothing is sent anywhere.

# 1. pick your store key (a passphrase + an org label). Keep them — they ARE the key.
export GALAHAD_STORE_PASSPHRASE='a long passphrase you choose'   # >= 12 chars
export GALAHAD_ORG='your-org'

#    optional: save the derived 32-byte key to a file for backup
galahad keygen --out ~/galahad.key --org "$GALAHAD_ORG"

# 2. check everything is ready (library loads? store key? store writable? GPU?)
galahad doctor

Then activate it in whichever way you serve:

vLLM

export GALAHAD_CACHE_DIR=/var/galahad      # the store, on fast local disk
vllm serve <model> \
  --kv-transfer-config '{"kv_connector":"GalahadConnector","kv_role":"kv_both"}'

vLLM discovers the connector by itself — no module path, no PYTHONPATH.

SGLang

export GALAHAD_CACHE_DIR=/var/galahad
python -m sglang.launch_server --model-path <model> \
  --enable-hierarchical-cache --hicache-ratio 1.5 --hicache-storage-backend dynamic \
  --hicache-storage-backend-extra-config \
  '{"backend_name":"galahad","module_path":"galahad_vllm.sglang_backend","class_name":"GalahadHiCacheStorage"}'

Your own code (bare)

Link libgalahad.so and call its C ABI directly; the store key comes from GALAHAD_STORE_PASSPHRASE + GALAHAD_ORG (or GALAHAD_STORE_KEY_FILE). See the wiki for the five-minute check.


The galahad command

pip install galahad-kv gives you one command for everything:

command what it does
galahad help activation for vLLM / SGLang / bare, in one place
galahad keygen derive and back up the store key from your passphrase + org
galahad doctor health check — library loads? store key? store writable? GPU?
galahad version library, ABI, engine and transport

No licence commands: the free edition needs none.


What you get

  • Memory that survives restarts. What was remembered on one run is available on the next, without recomputing it.
  • Encrypted at rest (AES-256-GCM). The key is derived from your passphrase + org; nothing is stored by us.
  • Your memory is portable. Because the key comes from your passphrase + org, not from the machine, you can copy the store to another of your own servers, set the same passphrase + org there, and it opens — byte-for-byte. A wrong passphrase opens nothing.
  • No licence, no account, no call home. The free edition has no licence or registration tools and no network path — there is nothing in it to phone home with.
  • One install, both engines. The same wheel works with vLLM and SGLang, on any model your engine can run.

Scope (free homelab edition)

  • Hardware: up to 4 consumer NVIDIA GeForce RTX GPUs, each ≤ 36 GiB VRAM (a 4×RTX 5090 rig runs free). Datacenter / professional cards, more than four GPUs, and multi-node / Kubernetes are a separate licensed edition.
  • One serving process = one trust domain. Do not put mutually-untrusted users behind one server; per-customer isolation is a licensed feature.
  • Platform: Linux x86-64 (manylinux_2_28, glibc ≥ 2.28), Python 3.10–3.14. macOS / Apple Silicon is planned for a later release.
  • Documentation & guides: the project wiki
  • Issues & contact: see the project page

© 2026 Corbenic AI — Sietse Schelpe. All rights reserved. Galahad-KV is proprietary software. Author: Sietse Schelpe — Corbenic AI.

Metadata

Release files for galahad-kv 1.35.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for galahad-kv 1.35.1
File Actions
galahad_kv-1.35.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Total release size: 71.1 MB

Release files / galahad_kv-1.35.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.1-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.3 MB
Tags CPython 3.14 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
5b94a3eaf5b9bfb803bcb85d7e4d86ed28f1d95fe64c4042769db4317657b4f8
BLAKE2b-256 checksum
How to use checksums
7af90797cd76ed76c4366ab8233b7901a5e682546d571ea5dfcf7c9294a4c5a9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.13 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
0a07602769ee588c80b4edf9ecd97c27486ec278159d5811e87487e015327ad4
BLAKE2b-256 checksum
How to use checksums
4d825b8738c7d607a7d1e0c7f87db1e768b370c7256a602774d89557f7bc263b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.3 MB
Tags CPython 3.12 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
9b519234db61386f2e097cc91165fca1efa8c2b5d9b3254be1bbc4155d3e698a
BLAKE2b-256 checksum
How to use checksums
0855f568cb0a9b9ccf6e9e166d71d2bfdb4399eec03b105c10bcc95f6bd58aed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.11 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
40e54c5f2579dc9b203ec7a558d4df9d89d37d744f60e1378c568e2fee29df18
BLAKE2b-256 checksum
How to use checksums
573b07bdf409b9f13bd46e1721595ad713e42eded835028c28030eef3f070eea
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.10 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
b3bc2526d09694af0bfda43648f5ff89a2d5d50f6c912b1ac48114939bd88d43
BLAKE2b-256 checksum
How to use checksums
640d8ac2ea00cb642eec179a6435e8ce182fa6b13e0fd064b669104f5c1d5094
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Security for galahad-kv 1.35.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page