4 projects
isagellm
sageLLM: Modular LLM inference engine with PD separation for domestic computing power
isagellm-comm
Communication Layer for sageLLM distributed inference
isagellm-core
sageLLM core runtime with PD separation (MVP)
isagellm-backend
sageLLM backend provider abstraction (CPU/CUDA/Ascend/Kunlun/DCU/MThreads)
