Introduction
sgl-deep-gemm is a pypi package built from SGLang's customized branch of DeepGemm. Comparing with origina DeepGemm, it supports the following features to better support SGLang:
- ABI support: with the help of tvm-ffi wrappers, a single wheel can run on different python versions.
- pypi support: easy installation with
pip install sgl-deep-gemm. No need to manually search for wheel links. - Fast iteration: add custom kernels and bump versions at no time.
Usage
To build it locally, run bash build_sgl_deep_gemm.sh, then pip install the wheel generated under dist.
To release a new set of wheels, please contact SGLang team and run the release workflow under SGLang repo
For each major version release (0.X.Y -> 0.(X+1).0), a new branch should be created (release/v0.(X+1).0) for stability purpose.
For any incoming pull requests, it should be rebased upon dev branch. Any newly added or modified tests should be put under sgl_deep_gemm/tests
Release files for sgl-deep-gemm 0.1.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sgl_deep_gemm-0.1.6-py3-none-manylinux2014_x86_64.whl | Python 3 | none | Linux glibc 2.17+ x86-64 | Details |
| sgl_deep_gemm-0.1.6-py3-none-manylinux2014_aarch64.whl | Python 3 | none | Linux glibc 2.17+ ARM64 | Details |
Total release size: 9.5 MB
Release files / sgl_deep_gemm-0.1.6-py3-none-manylinux2014_x86_64.whl
| Download URL | sgl_deep_gemm-0.1.6-py3-none-manylinux2014_x86_64.whl |
|---|---|
| Size | 4.8 MB |
| Tags | Linux glibc 2.17+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
d86c230fd4bfced4831ad794fb54b87e1809feb5432477f60b568135688c3f49
|
|
BLAKE2b-256 checksum How to use checksums |
1e68c649391b20e37b85f2b43c49dcfd533cecae5adb06572f10516a61242b57
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / sgl_deep_gemm-0.1.6-py3-none-manylinux2014_aarch64.whl
| Download URL | sgl_deep_gemm-0.1.6-py3-none-manylinux2014_aarch64.whl |
|---|---|
| Size | 4.7 MB |
| Tags | Linux glibc 2.17+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
eb2fe4b9ad9396f4095e93fcd9eb0a61e35c2980fcdfb803f485de35f4e028e0
|
|
BLAKE2b-256 checksum How to use checksums |
94a0bd1a89bc73a351f658687f9decb9f315af669401f27068e0be628ef745c7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
