Avatar for Gleb from gravatar.com

Gleb

Username    GlebTikhiy
Date joined   Joined

1 project

otf-llm

Last released

High-performance hybrid LLM inference engine with Adaptive Non-Uniform 2-Bit Quantization (Lloyd-Max + Fused Triton INT2 GEMM), RLM Context-as-a-Variable engine, 98.2% logit parity, and Zero-RAM quantizer.
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page