Skip to main content

OpenLake for vLLM

openlake-vllm packages the OpenLake KV-cache client, the openlaked daemon, the OpenLake vLLM connector, and the OpenLake control-plane UI for Linux.

Version 0.8.1 provides the non-RDMA local/H2 transport as a cp310-abi3-manylinux_2_28_x86_64 wheel. It supports regular CPython 3.10 and newer on x86-64 Linux. Install vLLM separately for the connector runtime.

The RDMA/UCX build, ExANS CUDA codec, source distribution, and aarch64 wheel are not included in this package release.

Project source and documentation are available at github.com/openlake-project/openlake.

Release files for openlake-vllm 0.8.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for openlake-vllm 0.8.1
File Interpreter ABI Platform
openlake_vllm-0.8.1-cp310-abi3-manylinux_2_28_x86_64.whl CPython 3.10 abi3 Linux glibc 2.28+ x86-64 Details

Release files / openlake_vllm-0.8.1-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL openlake_vllm-0.8.1-cp310-abi3-manylinux_2_28_x86_64.whl
Size 66.7 MB
Tags CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
2f2eea136125e34238895e11398ed2a115a5e19eff0bda78430f03ed51da57ec
BLAKE2b-256 checksum
How to use checksums
39f983c9b26070df1b845f6dd6728a0a72d34af0a36aea0444570ba3170cdf6a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.10.20

Release history Release notifications | RSS feed

This release

0.8.1 This release

1 release file

0.8.0

1 release file

0.6.1

1 release file

0.6.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page