5 projects
ray-cpp
A subpackage of Ray which provides the Ray C++ API.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
event-metrics
An embedded, event-time metric collection library
modelzoo
Python package for querying ModelZoo.Live
clipper-admin
Admin commands for the Clipper prediction-serving system