6 projects
vectorch-aops
aops: kernel operators for LLM inference by vectorch (placeholder; first release coming soon)
vectorch-iops
iops: CUDA kernels for LLM inference by vectorch (placeholder; first release coming soon)
vectorch-sllm
sllm: a high-performance LLM inference engine (placeholder; first release coming soon)
orion-search
orion: a hyper search solution
scalellm
A high-performance inference system for large language models.
minitf
Simplified version of Tensorflow for learning purposes.