fusedtok

Last released Sep 21, 2026

Fused CUDA kernels for LLM inference: attention decode (contiguous + paged kv-cache), RMSNorm, RoPE, SwiGLU, fused sampling, INT8 quantized GEMM - zero-copy torch support