Shared asymmetrically-compressed KV cache pool for multi-agent LLM inference
Project description
PolyKV
Shared asymmetric TurboQuant-compressed KV memory for multi-agent LLMs.
Installation
pip install -r requirements.txt
Reproduce Phase 0 Results
python experiment.py
Results
See RESULTS.md
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
polykv_llm-0.1.0.tar.gz
(8.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file polykv_llm-0.1.0.tar.gz.
File metadata
- Download URL: polykv_llm-0.1.0.tar.gz
- Upload date:
- Size: 8.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1428e015d6d6eeba60144840168a714c704ed620537a31143800ba6d19a339a8
|
|
| MD5 |
969dd1add3bb62625036b2653a9f7eef
|
|
| BLAKE2b-256 |
2f5b946eab1555055a61070ce9a512acaa985b50de12c7af098fbc62189b816f
|
File details
Details for the file polykv_llm-0.1.0-py3-none-any.whl.
File metadata
- Download URL: polykv_llm-0.1.0-py3-none-any.whl
- Upload date:
- Size: 9.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2556409ee283b9d0151fb35a491e07bc848ce6a0fed40f833f210f6075822aea
|
|
| MD5 |
733a7655a770b7cc10cff57b0dae6225
|
|
| BLAKE2b-256 |
49abbb8205a15297fe9c165bebd977a57acadcc82c9fa80ce6658b2966b73edf
|
