Avatar for Hai-Wenxiang from gravatar.com
Username    Hai-Wenxiang
Date joined   Joined

1 project

fusedtok

Last released

Fused CUDA kernels for LLM inference: RMSNorm, RoPE, SwiGLU, sampling ops, with zero-copy torch support

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page