Skip to main content

Prebuilt sgl-kernel for AMD Radeon RDNA3 (gfx1100)

SGLang's HIP path imports sgl_kernel unconditionally, and the sglang-kernel wheel on PyPI is CUDA-only -- it looks for libnvrtc.so.13. Building for RDNA3 from source means fetching ~125 MB of SGLang sources and running a compiler, which is a lot to ask, and impossible on links that cannot hold a large transfer open.

This wheel is that kernel, already compiled for gfx1100, with the patches from https://github.com/AMD-AIM/sglang-radeon applied:

  • the architecture allowlist widened past gfx942/gfx950/gfx1250
  • RDNA3 given the 48 KB LDS budget it actually has, not the 128 KB one
  • the GPTQ kernel compiled and its ops registered for ROCm, which upstream never does -- this is what lets a 27B model run 4-bit on a single 48 GB card

It installs the same sgl_kernel module as upstream, so it is a drop-in replacement. Uninstall sglang-kernel first if it is present.

Requires: ROCm 7.x, PyTorch with HIP, Python 3.12, an RDNA3 GPU. Verified on Radeon PRO W7900.

Use with the plugin, which supplies the runtime shims::

pip install --no-deps sglang-radeon-rdna3 sglang-kernel-rdna3
sglang-rdna3 doctor

Metadata

Release files for sglang-kernel-rdna3 0.4.6.post1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for sglang-kernel-rdna3 0.4.6.post1
File Interpreter ABI Platform
sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.34+ x86-64 Details

Release files / sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl

Download URL sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl
Size 5.1 MB
Tags CPython 3.12 Linux glibc 2.34+ x86-64
SHA-256 checksum
How to use checksums
0a4338aee3f00b1eb522ca304a956c610a0fc436fa46f6c8e5bb03df1b5493ab
BLAKE2b-256 checksum
How to use checksums
8607724a607e84af09f27d56135070961ce49b4dcbd11ac9fbf966cbf4f76de9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.10.12

Release history Release notifications | RSS feed

This release

0.4.6.post1 This release

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page