Skip to main content
Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 1.35.1 instead.

Galahad-KV

Long-term memory for AI models — a KV-cache layer for vLLM and SGLang.

Galahad keeps the KV cache your model already computed, encrypted on disk, and gives it back on the next run — so a long prompt, a document, or a conversation is remembered across requests and across restarts instead of being recomputed every time. It installs with one command and the serving engine finds it automatically.

pip install galahad-kv

Linux x86-64, Python 3.10–3.14. libgalahad.so ships inside the wheel — no compiler, no build step. (macOS / Apple Silicon is planned for a later release; not supported yet.)

Free homelab edition. This build runs free on a homelab — up to 4 consumer NVIDIA GeForce RTX GPUs — with no licence, no account, and no call home. Nothing is ever sent anywhere. Datacenter GPUs (A100 / H100 / L40S / B200 …), more than four GPUs, and multi-node / Kubernetes are a separate licensed edition.


Quick start

No licence and no sign-up. The only thing you choose is a store key — a passphrase and an org name — because your memory on disk is encrypted (AES-256-GCM). The same passphrase + org always derive the same key, on any machine, so nothing is stored by us and nothing is sent anywhere.

# 1. pick your store key (a passphrase + an org label). Keep them — they ARE the key.
export GALAHAD_STORE_PASSPHRASE='a long passphrase you choose'   # >= 12 chars
export GALAHAD_ORG='your-org'

#    optional: save the derived 32-byte key to a file for backup
galahad keygen --out ~/galahad.key --org "$GALAHAD_ORG"

# 2. check everything is ready (library loads? store key? store writable? GPU?)
galahad doctor

Then activate it in whichever way you serve:

vLLM

export GALAHAD_CACHE_DIR=/var/galahad      # the store, on fast local disk
vllm serve <model> \
  --kv-transfer-config '{"kv_connector":"GalahadConnector","kv_role":"kv_both"}'

vLLM discovers the connector by itself — no module path, no PYTHONPATH.

SGLang

export GALAHAD_CACHE_DIR=/var/galahad
python -m sglang.launch_server --model-path <model> \
  --enable-hierarchical-cache --hicache-ratio 1.5 --hicache-storage-backend dynamic \
  --hicache-storage-backend-extra-config \
  '{"backend_name":"galahad","module_path":"galahad_vllm.sglang_backend","class_name":"GalahadHiCacheStorage"}'

Your own code (bare)

Link libgalahad.so and call its C ABI directly; the store key comes from GALAHAD_STORE_PASSPHRASE + GALAHAD_ORG (or GALAHAD_STORE_KEY_FILE). See the wiki for the five-minute check.


The galahad command

pip install galahad-kv gives you one command for everything:

command what it does
galahad help activation for vLLM / SGLang / bare, in one place
galahad keygen derive and back up the store key from your passphrase + org
galahad doctor health check — library loads? store key? store writable? GPU?
galahad version library, ABI, engine and transport

No licence commands: the free edition needs none.


What you get

  • Memory that survives restarts. What was remembered on one run is available on the next, without recomputing it.
  • Encrypted at rest (AES-256-GCM). The key is derived from your passphrase + org; nothing is stored by us.
  • Your memory is portable. Because the key comes from your passphrase + org, not from the machine, you can copy the store to another of your own servers, set the same passphrase + org there, and it opens — byte-for-byte. A wrong passphrase opens nothing.
  • No licence, no account, no call home. The free edition has no licence or registration tools and no network path — there is nothing in it to phone home with.
  • One install, both engines. The same wheel works with vLLM and SGLang, on any model your engine can run.

Scope (free homelab edition)

  • Hardware: up to 4 consumer NVIDIA GeForce RTX GPUs, each ≤ 36 GiB VRAM (a 4×RTX 5090 rig runs free). Datacenter / professional cards, more than four GPUs, and multi-node / Kubernetes are a separate licensed edition.
  • One serving process = one trust domain. Do not put mutually-untrusted users behind one server; per-customer isolation is a licensed feature.
  • Platform: Linux x86-64 (manylinux_2_28, glibc ≥ 2.28), Python 3.10–3.14. macOS / Apple Silicon is planned for a later release.
  • Documentation & guides: the project wiki
  • Issues & contact: see the project page

© 2026 Corbenic AI — Sietse Schelpe. All rights reserved. Galahad-KV is proprietary software. Author: Sietse Schelpe — Corbenic AI.

Metadata

Release files for galahad-kv 1.35.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for galahad-kv 1.35.0
File Actions
galahad_kv-1.35.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.35.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.35.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 Details for galahad_kv-1.35.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Total release size: 71.1 MB

Release files / galahad_kv-1.35.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.3 MB
Tags CPython 3.14 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
86c6470d19912af3ee41c2734a204ae2497ac5d5644e75898291bde8b6719d4c
BLAKE2b-256 checksum
How to use checksums
b8c485860352e3f57c23dc8d47e479c52f143a03de844777a209bc0c361da460
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.13 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
2b22363150ef04e47d4bb6b356d7e101f1b7636ca5cf8c43b1a1c61830347cc6
BLAKE2b-256 checksum
How to use checksums
b7fd27923835b2dc15ad539d43f176940ae4161cdf2c3571812370d392ccdf6d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.12 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
002da4fcc161677e7bf1ca4d8159397e5291c4a90eb1252fc01ebaa95c88bdee
BLAKE2b-256 checksum
How to use checksums
dbefb235eda5de290f765feb3fc253f29f2588a1162b898dc8140154ad9e8eb2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.11 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
26172c7fdd1034d8f5285eec7afcd57963f33575fe5db4a0c157c02fe87661ed
BLAKE2b-256 checksum
How to use checksums
20b121b02a534c38d85e344a7c7370872c173996ef94c72683924ba21679f57a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.35.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.35.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 14.2 MB
Tags CPython 3.10 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
a8330c2ebdc502a2482caffcf108ef49859cc2bd95866342fc99fabf7a3cf8aa
BLAKE2b-256 checksum
How to use checksums
4bb3e2d34a0283a2470fa154a6f2274533f770c79d1cb3543cf788cbb6246b4d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Security for galahad-kv 1.35.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page