Last released Jul 24, 2026
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (Ascend NPU version)
Last released Jul 3, 2026
Local KV cache hit-rate simulator for JSONL traces.
Supported by
