This release is a pre-release and may not be stable for production use.
Introduction
sgl-deep-gemm is a pypi package built from SGLang's customized branch of DeepGemm. Comparing with origina DeepGemm, it supports the following features to better support SGLang:
- ABI support: with the help of tvm-ffi wrappers, a single wheel can run on different python versions.
- pypi support: easy installation with
pip install sgl-deep-gemm. No need to manually search for wheel links. - Fast iteration: add custom kernels and bump versions at no time.
Usage
To build it locally, run bash build_sgl_deep_gemm.sh, then pip install the wheel generated under dist.
To release a new set of wheels, please contact SGLang team and run the release workflow under SGLang repo
For each major version release (0.X.Y -> 0.(X+1).0), a new branch should be created (release/v0.(X+1).0) for stability purpose.
For any incoming pull requests, it should be rebased upon dev branch. Any newly added or modified tests should be put under sgl_deep_gemm/tests
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sgl_deep_gemm-0.1.4rc0-py3-none-manylinux2014_x86_64.whl.
File metadata
- Download URL: sgl_deep_gemm-0.1.4rc0-py3-none-manylinux2014_x86_64.whl
- Upload date:
- Size: 4.7 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b03eb174ed06fabb49db8fc5722be16fa08b067f51f92f0154177d0f42f66f09
|
|
| MD5 |
7dcab7f6475babe7984c1a6b33732a5f
|
|
| BLAKE2b-256 |
e9f171f1d4d2c45e124876666146b21fe145f3a3c7012ac0ca3a6cc4a2a308b2
|
File details
Details for the file sgl_deep_gemm-0.1.4rc0-py3-none-manylinux2014_aarch64.whl.
File metadata
- Download URL: sgl_deep_gemm-0.1.4rc0-py3-none-manylinux2014_aarch64.whl
- Upload date:
- Size: 4.6 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f0e65bcbef54bebdf34549f4a9a35a0913204f6764891a6f1cbdbcde6f024694
|
|
| MD5 |
1312e554574aa5d5dfe42de5e8e79d92
|
|
| BLAKE2b-256 |
8d681bece40cfbe240e98057a9d53a778d1676464a901b2b757d0238abe8ca47
|
