7 projects
pegaflow-llm-cu13
High-performance key-value storage engine with Python bindings
pegaflow-llm
High-performance key-value storage engine with Python bindings
mooncake-transfer-engine-non-cuda
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (Non-CUDA version)
mooncake-transfer-engine
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training.
mooncake-transfer-engine-efa-non-cuda
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (AWS EFA, Non-CUDA version)
mooncake-transfer-engine-efa-cuda13
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (AWS EFA, CUDA 13 version)
mooncake-transfer-engine-efa
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (AWS EFA, CUDA version)
