5 projects
vec-inf
Efficient LLM inference on Slurm clusters using vLLM.
vbll
None
kscope
A user toolkit for analyzing and interfacing with Large Language Models (LLMs)
flex-model
FlexModel - A Framework for Interpretability of Distributed Large Language Models
pylingua
A user toolkit for analyzing and interfacing with Large Language Models (LLMs)
