Avatar for Prajwal Pujari from gravatar.com

Prajwal Pujari

Username    Prajwal2002PI
Date joined   Joined

2 projects

mini-infer

Last released

A minimal, high-performance continuous-batching LLM inference engine with paged KV-cache, prefix caching, and speculative decoding for Qwen2.5.

servebench

Last released

Load-test any OpenAI-compatible LLM endpoint: TTFT, TPOT, ITL, throughput, goodput, charts.
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page