Avatar for Gavin Li from gravatar.com

Gavin Li

Username    gavinli
Date joined   Joined

1 project

airllm

Last released

AirLLM runs 70B large language models on a single 4GB GPU without quantization, distillation or pruning. Kimi K3 2.8T on under 4GB, Qwen3.8-Flash-Next 125B on 6GB, DeepSeek-V3 671B on ~12GB. Train Qwen3.8-Flash-Next under 6GB.
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page