Introduction
sgl-deep-gemm is a pypi package built from SGLang's customized branch of DeepGemm. Comparing with origina DeepGemm, it supports the following features to better support SGLang:
- ABI support: with the help of tvm-ffi wrappers, a single wheel can run on different python versions.
- pypi support: easy installation with
pip install sgl-deep-gemm. No need to manually search for wheel links. - Fast iteration: add custom kernels and bump versions at no time.
Usage
To build it locally, run bash build_sgl_deep_gemm.sh, then pip install the wheel generated under dist.
To release a new set of wheels, please contact SGLang team and run the release workflow under SGLang repo
For each major version release (0.X.Y -> 0.(X+1).0), a new branch should be created (release/v0.(X+1).0) for stability purpose.
For any incoming pull requests, it should be rebased upon dev branch. Any newly added or modified tests should be put under sgl_deep_gemm/tests
Release files for sgl-deep-gemm 0.1.5.post3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_x86_64.whl | Python 3 | none | Linux glibc 2.17+ x86-64 | Details |
| sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_aarch64.whl | Python 3 | none | Linux glibc 2.17+ ARM64 | Details |
Total release size: 9.5 MB
Release files / sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_x86_64.whl
| Download URL | sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_x86_64.whl |
|---|---|
| Size | 4.8 MB |
| Tags | Linux glibc 2.17+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
e951730cad2f047c16aab39a1ca5b560bff9937d3b079ecde86733c88141582b
|
|
BLAKE2b-256 checksum How to use checksums |
b0a890b5b2f3f78025be2112fb7c83945e34b4c44f57ce87ef8ef30bede570ca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_aarch64.whl
| Download URL | sgl_deep_gemm-0.1.5.post3-py3-none-manylinux2014_aarch64.whl |
|---|---|
| Size | 4.7 MB |
| Tags | Linux glibc 2.17+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
1a85fe914d4e2c11886dca69a81501de740f60569c441a34a67fc2ffdac78737
|
|
BLAKE2b-256 checksum How to use checksums |
c0f890a3084277d1f7fbbdd2aec95470ccc50fa75d0ac0d41b6acd3408306df2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
