Skip to main content
Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 1.35.1 instead.

Galahad-KV

Long-term memory for AI models — a KV-cache layer for vLLM and SGLang.

Galahad keeps the KV cache your model already computed, encrypted on disk, and gives it back on the next run — so a long prompt, a document, or a conversation is remembered across requests and across restarts instead of being recomputed every time. It installs with one command and the serving engine finds it automatically.

pip install galahad-kv

Linux x86-64, Python 3.10–3.14. libgalahad.so ships inside the wheel — no compiler, no build step.

Beta. Galahad-KV is launching as a beta with paid pilots. It is in active use and tested on vLLM and SGLang; limits are stated plainly and are being improved through pilots.


Quick start

Every install needs a licence — it is also the encryption key for your stored memory, and it never leaves your machine.

# 1. a free licence (one GPU, non-commercial, 12 months) — or `galahad buy` for more
galahad free --org your-org-key --email you@company.com --accept-non-commercial

# 2. check everything is ready
galahad doctor

Then activate it in whichever way you serve:

vLLM

export GALAHAD_CACHE_DIR=/var/galahad
vllm serve <model> \
  --kv-transfer-config '{"kv_connector":"GalahadConnector","kv_role":"kv_both"}'

vLLM discovers the connector by itself — no module path, no PYTHONPATH.

SGLang

export GALAHAD_CACHE_DIR=/var/galahad
python -m sglang.launch_server --model-path <model> \
  --enable-hierarchical-cache --hicache-ratio 1.5 --hicache-storage-backend dynamic \
  --hicache-storage-backend-extra-config \
  '{"backend_name":"galahad","module_path":"galahad_vllm.sglang_backend","class_name":"GalahadHiCacheStorage"}'

Your own code (bare)

Link libgalahad.so and call its C ABI directly; the licence supplies the key. See the wiki for the five-minute check.


The galahad command

pip install galahad-kv gives you one command for everything:

command what it does
galahad help activation for vLLM / SGLang / bare, in one place
galahad doctor health check — library loads? licence valid? store writable?
galahad free a free licence (one GPU, non-commercial)
galahad buy a paid licence (more GPUs / commercial) — opens checkout
galahad quote volume or custom terms
galahad status is a licence installed and enforcing?
galahad points how many GPU-points this machine is (pricing)
galahad version library, ABI, engine and transport

What you get

  • Memory that survives restarts. What was remembered on one run is available on the next, without recomputing it.
  • Encrypted at rest. Your stored memory is encrypted. By default your licence unlocks it; nothing extra to manage.
  • Your key stays yours. Optionally hold your own key via GALAHAD_STORE_PASSPHRASE — it stays on your machine and is never sent to us. Lose it, lose the memory; that is the point.
  • One install, both engines. The same wheel works with vLLM and SGLang.
  • No surprises without a licence. Without one, it will not quietly do nothing — it tells you.

Known limits (beta, stated plainly)

  • One serving process = one trust domain. Do not put mutually-untrusted users behind one server; run separate processes, stores and keys per customer.
  • Version pins. vLLM 0.30, SGLang 0.5.20, matching transformers. Newer engine versions change internal APIs the connector binds to.
  • Linux only (manylinux_2_28, glibc ≥ 2.27), Python 3.10–3.14.
  • Documentation & guides: the project wiki
  • Issues & contact: see the project page

© 2026 Corbenic AI. All rights reserved. Galahad-KV is proprietary software; see the licence terms delivered with your key. Author: Corbenic AI.

Metadata

Release files for galahad-kv 1.31.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for galahad-kv 1.31.3
File Actions
galahad_kv-1.31.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.31.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.31.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.31.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.31.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.31.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.31.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.31.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
galahad_kv-1.31.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.28+ x86-64, Linux glibc 2.27+ x86-64 Details for galahad_kv-1.31.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Total release size: 65.1 MB

Release files / galahad_kv-1.31.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.31.3-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 13.0 MB
Tags CPython 3.14 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
4c139254ac050484131ae76d5b34da2e7dc2c9bf2c904d61c2f38ba3384da1fe
BLAKE2b-256 checksum
How to use checksums
57ebc023f24b668848066e2d615fa6b81e790b88f413990588f12a0528e8d1a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.31.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.31.3-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 13.0 MB
Tags CPython 3.13 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
2a5c951b89f662ef393aa2a6268967e2faf0d7484c2dc963295b1dbe719d1fbc
BLAKE2b-256 checksum
How to use checksums
21e95c77b2788914e2c6b22e79f14f4d45983fa4e4c5ffc471a4428f594017cc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.31.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.31.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 13.0 MB
Tags CPython 3.12 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
b83d65db40d54ec70461787c495b4b73dbeedb71d9962bddc2b15f1e0d9e2967
BLAKE2b-256 checksum
How to use checksums
1dc7f3556e3632b45482fc70e16a995365679b3597d464540e6eba5c31361a7a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.31.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.31.3-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 13.0 MB
Tags CPython 3.11 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
ac6e1da917d9b47f2597db4ff5705c54e2f45cee392146cead1d14701bdb79f1
BLAKE2b-256 checksum
How to use checksums
9bc8d87ae718ae612df2614a6ca68f22e60989794bda730a219be25072a5f26a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / galahad_kv-1.31.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl

Download URL galahad_kv-1.31.3-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Size 13.0 MB
Tags CPython 3.10 Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
cf3c7feea2a850c95649913072ee42d192c9f6b3dae6ce3d2e172d8b78c987f6
BLAKE2b-256 checksum
How to use checksums
2c082bd1376b2ba7b8a90ed5f5c0da90aa5991f61ab54518a0b28f16624ee42c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Security for galahad-kv 1.31.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page