Skip to main content

vllm-kvblockd

Native vLLM KVConnector-v1 for kvblockd — the single-binary LLM KV-cache store (DRAM → NVMe → S3 over plain TCP). This connector produced every published TTFT number in the repo (receipts: docs/BENCHMARKS.md, docs/CLAIMS.md).

Quick start: docs/INTEGRATIONS.md → "vLLM native connector". TP=1 only (refuses multi-GPU at boot); requires PYTHONHASHSEED=0.

Metadata

Release files for vllm-kvblockd 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vllm-kvblockd 0.1.0
File Size Uploaded
vllm_kvblockd-0.1.0.tar.gz 142.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for vllm-kvblockd 0.1.0
File Interpreter ABI Platform
vllm_kvblockd-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 223.1 kB

Release files / vllm_kvblockd-0.1.0.tar.gz

Download URL vllm_kvblockd-0.1.0.tar.gz
Size 142.5 kB
Tags Source
SHA-256 checksum
How to use checksums
147b19eb3f957de0bafe39e007cd0c33c70465fe1caa5aea76b2b66b9551e56c
BLAKE2b-256 checksum
How to use checksums
85c0862019a572c978c84699301ffc29f5960b46cb910e1610701b780f05a547
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.12

Release files / vllm_kvblockd-0.1.0-py3-none-any.whl

Download URL vllm_kvblockd-0.1.0-py3-none-any.whl
Size 80.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
66dfb59a2a5b3a655606470e297a0bdd0aec632fe4bfdd7607e2cf4d3aacd437
BLAKE2b-256 checksum
How to use checksums
ff9ac1852c1e5e9ee1146c6acd4113079b2a866cbc31ad7ad2d45ecce7ddb660
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.12

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page