Prebuilt sgl-kernel for AMD Radeon RDNA3 (gfx1100)
SGLang's HIP path imports sgl_kernel unconditionally, and the
sglang-kernel wheel on PyPI is CUDA-only -- it looks for
libnvrtc.so.13. Building for RDNA3 from source means fetching ~125 MB of
SGLang sources and running a compiler, which is a lot to ask, and impossible
on links that cannot hold a large transfer open.
This wheel is that kernel, already compiled for gfx1100, with the patches from https://github.com/AMD-AIM/sglang-radeon applied:
- the architecture allowlist widened past gfx942/gfx950/gfx1250
- RDNA3 given the 48 KB LDS budget it actually has, not the 128 KB one
- the GPTQ kernel compiled and its ops registered for ROCm, which upstream never does -- this is what lets a 27B model run 4-bit on a single 48 GB card
It installs the same sgl_kernel module as upstream, so it is a drop-in
replacement. Uninstall sglang-kernel first if it is present.
Requires: ROCm 7.x, PyTorch with HIP, Python 3.12, an RDNA3 GPU. Verified on Radeon PRO W7900.
Use with the plugin, which supplies the runtime shims::
pip install --no-deps sglang-radeon-rdna3 sglang-kernel-rdna3
sglang-rdna3 doctor
Metadata
Release files for sglang-kernel-rdna3 0.4.6.post1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl | CPython 3.12 | CPython 3.12 | Linux glibc 2.34+ x86-64 | Details |
Release files / sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl
| Download URL | sglang_kernel_rdna3-0.4.6.post1-cp312-cp312-manylinux_2_34_x86_64.whl |
|---|---|
| Size | 5.1 MB |
| Tags | CPython 3.12 Linux glibc 2.34+ x86-64 |
|
SHA-256 checksum How to use checksums |
0a4338aee3f00b1eb522ca304a956c610a0fc436fa46f6c8e5bb03df1b5493ab
|
|
BLAKE2b-256 checksum How to use checksums |
8607724a607e84af09f27d56135070961ce49b4dcbd11ac9fbf966cbf4f76de9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|