Last released Apr 6, 2026
Unified Attention: single projection replacing Q/K/V with 67% fewer parameters
Supported by