Avatar for StingLin from gravatar.com
Username    StingLin
Date joined   Joined

7 projects

tpu-inference

Last released

None

vllm-tpu

Last released

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-jax

Last released

None

vllm-jax-core

Last released

None

vllm-torchtpu

Last released

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-torchtpu-core

Last released

None

vllm-torchtpu-core-test

Last released

None
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page