4 projects
memkv-vllm
MemKV backend for vLLM native KV offloading: a secondary tier behind the CPU pool (TieringOffloadingSpec) or MemKV as the offload medium itself (MemKVOffloadingSpec).
memkv-sglang
sglang HiCacheStorage backend for the MemKV context memory store
memkv-lmcache
LMCache storage plugin that targets the MemKV context memory store; gives vLLM a MemKV-backed prefix cache via lmcache_connector.
minio
MinIO Python SDK for Amazon S3 Compatible Cloud Storage