spatial sparse convolution
Project description
SpConv: Spatially Sparse Convolution Library
spconv
is a project that provide heavily-optimized sparse convolution implementation with tensor core support. check benchmark to see how fast spconv 2.x runs.
Spconv 1.x code. We won't provide any support for spconv 1.x since it's deprecated. use spconv 2.x if possible.
Check spconv 2.x algorithm introduction to understand sparse convolution algorithm in spconv 2.x!
WARNING spconv < 2.1.4 users need to upgrade your version to 2.1.4, it fix a serious bug in SparseInverseConvXd.
Breaking changes in Spconv 2.x
Spconv 1.x users NEED READ THIS before using spconv 2.x.
Spconv 2.1 vs Spconv 1.x
- spconv now can be installed by pip. see install section in readme for more details. Users don't need to build manually anymore!
- Microsoft Windows support (only windows 10 has been tested).
- fp32 (not tf32) training/inference speed is increased (+50~80%)
- fp16 training/inference speed is greatly increased when your layer support tensor core (channel size must be multiple of 8).
- int8 op is ready, but we still need some time to figure out how to run int8 in pytorch.
- doesn't depend on pytorch binary, but you may need at least pytorch >= 1.5.0 to run spconv 2.x.
- since spconv 2.x doesn't depend on pytorch binary (never in future), it's impossible to support torch.jit/libtorch inference.
Spconv 2.x Development and Roadmap
Spconv 2.2 development has started. See this issue for more details.
See dev plan. A complete guide of spconv development will be released soon.
Usage
Firstly you need to use import spconv.pytorch as spconv
in spconv 2.x.
Then see this.
Don't forget to check performance guide.
Install
You need to install python >= 3.6 (>=3.7 for windows) first to use spconv 2.x.
You need to install CUDA toolkit first before using prebuilt binaries or build from source.
You need at least CUDA 10.2 to build and run spconv 2.x. We won't offer any support for CUDA < 10.2.
Prebuilt
We offer python 3.6-3.10 and cuda 10.2/11.1/11.3/11.4 prebuilt binaries for linux (manylinux).
We offer python 3.7-3.10 and cuda 10.2/11.1/11.4 prebuilt binaries for windows 10/11.
We will provide prebuilts for CUDA versions supported by latest pytorch release. For example, pytorch 1.10 provide cuda 10.2 and 11.3 prebuilts, so we provide them too.
For Linux users, you need to install pip >= 20.3 first to install prebuilt.
CUDA 11.1 will be removed in spconv 2.2 because pytorch 1.10 don't provide prebuilts for it.
pip install spconv
for CPU only (Linux Only). you should only use this for debug usage, the performance isn't optimized due to manylinux limit (no omp support).
pip install spconv-cu102
for CUDA 10.2
pip install spconv-cu111
for CUDA 11.1
pip install spconv-cu113
for CUDA 11.3 (Linux Only)
pip install spconv-cu114
for CUDA 11.4
NOTE It's safe to have different minor cuda version between system and conda (pytorch) in CUDA >= 11.0 because of CUDA Minor Version Compatibility. For example, you can use spconv-cu114 with anaconda version of pytorch cuda 11.1 in a OS with CUDA 11.2 installed.
For CUDA 10, we don't know whether spconv-cu102
works with CUDA 10.0 and 10.1. Users can have a try.
NOTE In Linux, you can install spconv-cuxxx without install CUDA to system! only suitable NVIDIA driver is required. for CUDA 11, we need driver >= 450.82.
Prebuilt GPU Support Matrix
See this page to check supported GPU names by arch.
CUDA version | GPU Arch List |
---|---|
10.2 | 52,60,61,70,75 |
11.x | 52,60,61,70,75,80,86 |
12.x | 60,61,70,75,80,86,90 |
Build from source for development (JIT, recommend)
The c++ code will be built automatically when you change c++ code in project.
For NVIDIA Embedded Platforms, you need to specify cuda arch before build: export CUMM_CUDA_ARCH_LIST="7.2"
for xavier, export CUMM_CUDA_ARCH_LIST="6.2"
for TX2, export CUMM_CUDA_ARCH_LIST="8.7"
for orin.
You need to remove cumm
in requires
section in pyproject.toml after install editable cumm
and before install spconv due to pyproject limit (can't find editable installed cumm
).
You need to ensure pip list | grep spconv
and pip list | grep cumm
show nothing before install editable spconv/cumm.
Linux
- uninstall spconv and cumm installed by pip
- install build-essential, install CUDA
git clone https://github.com/FindDefinition/cumm
,cd ./cumm
,pip install -e .
git clone https://github.com/traveller59/spconv
,cd ./spconv
,pip install -e .
- in python,
import spconv
and wait for build finish.
Windows
- uninstall spconv and cumm installed by pip
- install visual studio 2019 or newer. make sure C++ development component is installed. install CUDA
- set powershell script execution policy
- start a new powershell, run
tools/msvc_setup.ps1
git clone https://github.com/FindDefinition/cumm
,cd ./cumm
,pip install -e .
git clone https://github.com/traveller59/spconv
,cd ./spconv
,pip install -e .
- in python,
import spconv
and wait for build finish.
Build wheel from source (not recommend, this is done in CI.)
You need to rebuild cumm
first if you are build along a CUDA version that not provided in prebuilts.
Linux
- install build-essential, install CUDA
- run
export SPCONV_DISABLE_JIT="1"
- run
pip install pccm cumm wheel
- run
python setup.py bdist_wheel
+pip install dists/xxx.whl
Windows
- install visual studio 2019 or newer. make sure C++ development component is installed. install CUDA
- set powershell script execution policy
- start a new powershell, run
tools/msvc_setup.ps1
- run
$Env:SPCONV_DISABLE_JIT = "1"
- run
pip install pccm cumm wheel
- run
python setup.py bdist_wheel
+pip install dists/xxx.whl
Note
The work is done when the author is an employee at Tusimple.
LICENSE
Apache 2.0
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distributions
Hashes for spconv_cu111-2.1.13-cp310-cp310-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6efeb908e2b2f399d90d01be8017580179bfc14cd29f6be4d1f64aed53a2dff6 |
|
MD5 | 7cb088ac715c22f42374ce7acdee446c |
|
BLAKE2b-256 | f90d338aa9e65de88d30da9a1b355e33d66811fa9b93d69c31f42c662c36a9af |
Hashes for spconv_cu111-2.1.13-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbde0c8f0cac5824c16c48e36639ab1c7f846ec6eacd8057b0d68c0b36814dc3 |
|
MD5 | a6f726715d63b610ec9672290ecad9d2 |
|
BLAKE2b-256 | 1c14b1bc90251d8d6b82cf4154e1d2f125afd627de0cf60f84f0423adda1376d |
Hashes for spconv_cu111-2.1.13-cp39-cp39-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 205ee6d4debfea7ddf406bc1361a8b0a13620bf99ed2659a2c21bafd96303c5b |
|
MD5 | ef93687bba50eab9711dcd8d0a14cff9 |
|
BLAKE2b-256 | c2dfc7bfe943ca71e9df5d06051e96474f9e66cb5882085432a30c05c7daf75d |
Hashes for spconv_cu111-2.1.13-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7a6a6002d5dd71637c60cfee408e5614a8aa167af53863c815c124c985643fe0 |
|
MD5 | fa64b04381730b80297c5303aa1b6d9a |
|
BLAKE2b-256 | 539e40c8ddbeebfbd26192816aa2ddbf567275808ebc13cc438ea1a2ac3062a7 |
Hashes for spconv_cu111-2.1.13-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 50688cc5238f81114b2666036effa7e58cf11a0ce3e8428ad4eb288de279bbdf |
|
MD5 | 407e9ffe69ac326d9ed4292ffb987c38 |
|
BLAKE2b-256 | 501bc14b304cd7a8213567189f262ccc6233378880b094b9d60022f8d9e3bba4 |
Hashes for spconv_cu111-2.1.13-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa703b38f975467739bcca5c5a3d0645ec6ff8c5b04e6b153622174838590093 |
|
MD5 | fe94caac3c374284c4f1fcb268da3b16 |
|
BLAKE2b-256 | d1318fecbdb6205299b47fa7ce63da51fbd5564506ab9c17b502978f093e20d9 |
Hashes for spconv_cu111-2.1.13-cp37-cp37m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | defe7b8b205354acac544efc1834885f4841b94daae5f7e47806b1bb1ecc9f1d |
|
MD5 | 717d99951e6ce44ed46ecc6b658c530b |
|
BLAKE2b-256 | 9d5ab0ad24a822ba2942d8ce8c1f4ef84743f7c4c2397a7b75bae9679f72480d |
Hashes for spconv_cu111-2.1.13-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9d90664fb2894306113bff87252d49d0a3e06a8963919fcc53b2cdc7e92eface |
|
MD5 | 68320577cd7fbb7925d76bc9afb0bd1f |
|
BLAKE2b-256 | 32b75f25e19d437029afcaf571027c20d9880defaa59d96e9e1608bbcee88510 |
Hashes for spconv_cu111-2.1.13-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f35427bcc19acd68c5221b5fe82312c5b4e49f19bd3a0af3e6d4ccca5b282fcc |
|
MD5 | d80b938d8f267abd736b55eca24507a6 |
|
BLAKE2b-256 | 17822b8da8bb3ea97c67b888ab2d6000120d7bb8effa739b76e303a25db0343d |