9 projects
tpu-inference
None
torchax
torchax is a library for running Jax and PyTorch together
vllm-torchtpu
A high-throughput and memory-efficient inference and serving engine for LLMs
vllm-torchtpu-core
None
vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs
vllm-jax
None
vllm-jax-core
None
cllm-cuiq-test
A simple demo package
vllm-test-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs