Skip to main content

vllm-kvblockd

Native vLLM KVConnector-v1 for kvblockd — the single-binary LLM KV-cache store (DRAM → NVMe → S3 over plain TCP). This connector produced every published TTFT number in the repo (receipts: docs/BENCHMARKS.md, docs/CLAIMS.md).

Quick start: docs/INTEGRATIONS.md → "vLLM native connector". TP=1 only (refuses multi-GPU at boot); requires PYTHONHASHSEED=0.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vllm_kvblockd-0.1.0.tar.gz (142.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vllm_kvblockd-0.1.0-py3-none-any.whl (80.6 kB view details)

Uploaded Python 3

File details

Details for the file vllm_kvblockd-0.1.0.tar.gz.

File metadata

  • Download URL: vllm_kvblockd-0.1.0.tar.gz
  • Upload date:
  • Size: 142.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.12

File hashes

Hashes for vllm_kvblockd-0.1.0.tar.gz
Algorithm Hash digest
SHA256 147b19eb3f957de0bafe39e007cd0c33c70465fe1caa5aea76b2b66b9551e56c
MD5 a5314a720a0664d6331450f0460fa7e3
BLAKE2b-256 85c0862019a572c978c84699301ffc29f5960b46cb910e1610701b780f05a547

See more details on using hashes here.

File details

Details for the file vllm_kvblockd-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: vllm_kvblockd-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 80.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.12

File hashes

Hashes for vllm_kvblockd-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 66dfb59a2a5b3a655606470e297a0bdd0aec632fe4bfdd7607e2cf4d3aacd437
MD5 eb13af529fdf8ecb86ca7fb846b9e0ab
BLAKE2b-256 ff9ac1852c1e5e9ee1146c6acd4113079b2a866cbc31ad7ad2d45ecce7ddb660

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page