CUda Matrix Multiply library
Project description
cumm
CUda Matrix Multiply library.
cumm
is developed during learning of CUTLASS, which use too much c++ template and make code unmaintainable. So I develop pccm, use python as meta programming language, to replace c++ template meta programming.
Now pccm
become a foundational framework of cumm
and my other c++ project such as spconv.
cumm
also contains a python asyncio-based gemm simulator that share same meta program with CUDA code, enable gemm visualization and easy debug experience.
BREAKING CHANGES
- 0.3.1: tv::DType enum value changed, this will affect all binary code of tv::Tensor user. you must recompile all code if upgrade to cumm >= 0.3.1.
News
- Ampere feature support (by EvernightAurora)
Install
Prebuilt
We offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for linux (manylinux).
We offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for windows 10/11.
pip install cumm
for CPU-only
pip install cumm-cu102
for CUDA 10.2
pip install cumm-cu113
for CUDA 11.3
pip install cumm-cu114
for CUDA 11.4
pip install cumm-cu117
for CUDA 11.7
pip install cumm-cu120
for CUDA 12.0
Build from source for development (JIT, recommend for develop)
WARNING Use code in tags!!! code in main branch may contain bugs.
The c++ code will be built automatically when you change c++ code in project.
Linux
- uninstall cumm installed by pip. you must ensure no "cumm" exists in
pip list | grep cumm
- install build-essential, install CUDA
git clone https://github.com/FindDefinition/cumm
,cd ./cumm
,git checkout tags/<tag_name>
,pip install -e .
- in python,
import cumm
and wait for build finish.
Windows
- uninstall spconv and cumm installed by pip. you must ensure no "cumm" exists in
pip list | grep cumm
- install visual studio 2019 or newer. make sure C++ development component is installed. install CUDA
- set powershell script execution policy
- start a new powershell, run
tools/msvc_setup.ps1
git clone https://github.com/FindDefinition/cumm
,cd ./cumm
,git checkout tags/<tag_name>
,pip install -e .
- in python,
import cumm
and wait for build finish.
Build wheel from source
WARNING Use code in tags!!! code in main branch may contain bugs.
WARNING: If CUMM_CUDA_VERSION
is set with a CUDA version, following steps will create a wheel named "cumm-cuxxx", not "cumm", this means you must use cumm-cuxxx
in dependency of your project which depend on cumm, not cumm
. If CUMM_CUDA_VERSION
isn't set, cumm
will always built with CUDA, so the CUDA must exists in your system. The wheel name will be cumm
even if it is built with cuda.
Linux
It's recommend to build Linux packages in official build docker. Build with CUDA support don't need a real GPU.
Build in Official Docker
- select a cuda version. available: CUDA 11.1, 11.3, 11.4, 11.5, 12.0
- (Example for CUDA 11.4)
git clone https://github.com/FindDefinition/cumm
,cd ./cumm
,docker run --rm -e PLAT=manylinux2014_x86_64 -e CUMM_CUDA_VERSION=114 -v `pwd`:/io scrin/manylinux2014-cuda:cu114-devel-1.0.0 bash -c "source /etc/bashrc && /io/tools/build-wheels.sh"
Build in your environment
- install build-essential, install CUDA
- set env for installed cuda version. for example,
export CUMM_CUDA_VERSION="11.4"
. If you want to build CPU-only, runexport CUMM_CUDA_VERSION=""
. IfCUMM_CUDA_VERSION
isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will becumm
, otherwisecumm-cuxxx
- run
export CUMM_DISABLE_JIT="1"
- run
python setup.py bdist_wheel
+pip install dists/xxx.whl
Windows 10/11
- install visual studio 2019 or newer. make sure C++ development package is installed. install CUDA
- set powershell script execution policy
- start a new powershell, run
tools/msvc_setup.ps1
- set env for installed cuda version. for example,
$Env:CUMM_CUDA_VERSION = "11.4"
. If you want to build CPU-only, run$Env:CUMM_CUDA_VERSION = ""
. . IfCUMM_CUDA_VERSION
isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will becumm
, otherwisecumm-cuxxx
- run
$Env:CUMM_DISABLE_JIT = "1"
- run
python setup.py bdist_wheel
+pip install dists/xxx.whl
Contributers
- EvernightAurora: add ampere feature.
Note
The work is done when the author is an employee at Tusimple.
LICENSE
Apache 2.0
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Hashes for cumm_cu116-0.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 825212bbb63a134954c5d73aa1c1ec688ffa254f466de10b6aea1f7ca671f137 |
|
MD5 | 745ddcb823d353ec4bde988f77ffd916 |
|
BLAKE2b-256 | 0874c3200f4f1a8fc3589fd8f04a3b84c7d474a2339c2e8191a95b43c3765cb8 |
Hashes for cumm_cu116-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 22455d945f28727d2865faabb86bd3d734d85706dcb24101287245dce32714a9 |
|
MD5 | 603a805a0da86b21e098511668f0d387 |
|
BLAKE2b-256 | 0a89c7dfcef23ea1104a2b2215a2c550efd8b85a111022aa29ce64b0b08f3cdf |
Hashes for cumm_cu116-0.5.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a53787c513e0a5f81a928453d48c09dfa0f6415644877520b92a8440e029cb8e |
|
MD5 | 02c8b1dfaa76b5396628ff20b5dbedaa |
|
BLAKE2b-256 | cd5e3419249a49f62b3b1c1c1f94644497794c6c158f9062e9b3e6db764b00c5 |
Hashes for cumm_cu116-0.5.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 87a144f89d1a37f8a00bd8c108ff06874fa9a5703a1cbca2bd3d1c2db55ac19d |
|
MD5 | 3731eee8b3912fd1f35aba9ecf7bb284 |
|
BLAKE2b-256 | 206f3d771877b6e905bf31a905df45996c3ca866ce39249372d217801a6610d4 |
Hashes for cumm_cu116-0.5.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 20490a044524b33e54c4a6281175e9c4d48332bd1eea5d021294c7709b43b7b7 |
|
MD5 | 9e4ae3a00c01491442a5aecbc81e0594 |
|
BLAKE2b-256 | f02c4ecce05c9bbeb1dd40363aa53b1162e737fa875187514e2fa4b1a277461d |