Last released Oct 9, 2024
A lightweight, cross-platform latency and throughput profiler for LLMs
Supported by