KV cache index for LLM inference - radix tree and page table implementations
Project description
kv-index
KV cache index for LLM inference - radix tree and page table implementations
Status
This package is under development as part of the Shepherd project.
Installation
pip install kv-index
Coming Soon
This package will provide Python bindings (via PyO3) for the Rust implementation.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kv_index-0.0.1.tar.gz
(1.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file kv_index-0.0.1.tar.gz.
File metadata
- Download URL: kv_index-0.0.1.tar.gz
- Upload date:
- Size: 1.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b44f7a1e80c5a791a7398fc8c7a0442915d92277d6b673e28eb85d6b6ba1790d
|
|
| MD5 |
a212a2fdb3d96164fdb7d2e1c25330db
|
|
| BLAKE2b-256 |
1cac310712ddd4e81672c7eb6d5c5ec49f126c19964a9a72218768a149f852ee
|
File details
Details for the file kv_index-0.0.1-py3-none-any.whl.
File metadata
- Download URL: kv_index-0.0.1-py3-none-any.whl
- Upload date:
- Size: 1.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8b2992ee41cfca95251a9a5fe1c4bd52a153e3d57511327cb5e198c400cc8eca
|
|
| MD5 |
d4798368c082c0f174dcadd454331fc5
|
|
| BLAKE2b-256 |
0266a9cd0bafb8cc659e2c937c0b912fbfe07e6e6efb8b4e6f56c2cce74a2d6d
|
