Pre-release
This release is a pre-release and may not be stable for production use.
SPU: Secure Processing Unit
SPU (Secure Processing Unit) aims to be a provable, measurable secure computation device,
which provides computation ability while keeping your private data protected.
SPU could be treated as a programmable device, it's not designed to be used directly. Normally we use SecretFlow framework, which use SPU as the underline secure computing device.
Currently, we mainly focus on provable security. It contains a secure runtime that evaluates
XLA-like tensor operations,
which use MPC as the underline
evaluation engine to protect privacy information.
SPU python package also contains a simple distributed module to demo SPU usage, but it's NOT designed for production due to system security and performance concerns, please DO NOT use it directly in production.
Contribution Guidelines
If you would like to contribute to SPU, please check Contribution guidelines.
If you would like to use SPU for research purposes, please check research development guidelines from @fionser.
This documentation also contains instructions for build and testing.
Installation Guidelines
Supported platforms
| Linux x86_64 | Linux aarch64 | macOS x64 | macOS Apple Silicon | Windows x64 | Windows WSL2 x64 | |
|---|---|---|---|---|---|---|
| CPU | yes | yes | yes1 | yes | no | yes |
| NVIDIA GPU | experimental | no | no | n/a | no | experimental |
- Due to CI resource limitation, macOS x64 prebuild binary is no longer available.
Instructions
Please follow Installation Guidelines to install SPU.
Hardware Requirements
| General Features | FourQ based PSI | GPU |
|---|---|---|
| AVX/ARMv8 | AVX2/ARMv8 | CUDA 11.8+ |
Citing SPU
If you think SPU is helpful for your research or development, please consider citing our papers:
@inproceedings {spu,
author = {Junming Ma and Yancheng Zheng and Jun Feng and Derun Zhao and Haoqi Wu and Wenjing Fang and Jin Tan and Chaofan Yu and Benyu Zhang and Lei Wang},
title = {{SecretFlow-SPU}: A Performant and {User-Friendly} Framework for {Privacy-Preserving} Machine Learning},
booktitle = {2023 USENIX Annual Technical Conference (USENIX ATC 23)},
year = {2023},
isbn = {978-1-939133-35-9},
address = {Boston, MA},
pages = {17--33},
url = {https://www.usenix.org/conference/atc23/presentation/ma},
publisher = {USENIX Association},
month = jul,
}
@inproceedings{ditto,
title = {Ditto: Quantization-aware Secure Inference of Transformers upon {MPC}},
author = {Wu, Haoqi and Fang, Wenjing and Zheng, Yancheng and Ma, Junming and Tan, Jin and Wang, Lei},
booktitle = {Proceedings of the 41st International Conference on Machine Learning},
pages = {53346--53365},
year = {2024},
editor = {Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix},
volume = {235},
series = {Proceedings of Machine Learning Research},
month = {21--27 Jul},
publisher = {PMLR},
pdf = {https://raw.githubusercontent.com/mlresearch/v235/main/assets/wu24d/wu24d.pdf},
url = {https://proceedings.mlr.press/v235/wu24d.html},
abstract = {Due to the rising privacy concerns on sensitive client data and trained models like Transformers, secure multi-party computation (MPC) techniques are employed to enable secure inference despite attendant overhead. Existing works attempt to reduce the overhead using more MPC-friendly non-linear function approximations. However, the integration of quantization widely used in plaintext inference into the MPC domain remains unclear. To bridge this gap, we propose the framework named Ditto to enable more efficient quantization-aware secure Transformer inference. Concretely, we first incorporate an MPC-friendly quantization into Transformer inference and employ a quantization-aware distillation procedure to maintain the model utility. Then, we propose novel MPC primitives to support the type conversions that are essential in quantization and implement the quantization-aware MPC execution of secure quantized inference. This approach significantly decreases both computation and communication overhead, leading to improvements in overall efficiency. We conduct extensive experiments on Bert and GPT2 models to evaluate the performance of Ditto. The results demonstrate that Ditto is about $3.14\sim 4.40\times$ faster than MPCFormer (ICLR 2023) and $1.44\sim 2.35\times$ faster than the state-of-the-art work PUMA with negligible utility degradation.}
}
Acknowledgement
We thank the significant contributions made by Alibaba Gemini Lab and security advisories made by VUL337@NISL@THU.
1 maintainer
Metadata
1 maintainer
Release files for spu 0.10.0.dev20251208
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| spu-0.10.0.dev20251208.tar.gz | 82.2 MB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_x86_64.whl | CPython 3.11 | none | Linux glibc 2.28+ x86-64 | Details |
| spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_aarch64.whl | CPython 3.11 | none | Linux glibc 2.28+ ARM64 | Details |
| spu-0.10.0.dev20251208-cp311-none-macosx_14_0_arm64.whl | CPython 3.11 | none | macOS 14.0+ ARM64 | Details |
Total release size: 245.1 MB
Release files / spu-0.10.0.dev20251208.tar.gz
| Download URL | spu-0.10.0.dev20251208.tar.gz |
|---|---|
| Size | 82.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2039995c20168f6273651697cb3f4336b760f6909d69358eb8c5e2b8d54d41d3
|
|
BLAKE2b-256 checksum How to use checksums |
ca85fc0142b26fd79f83e290e396d58033bd76a6822c47698de67bfde79ec140
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.16 {"installer":{"name":"uv","version":"0.9.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_x86_64.whl
| Download URL | spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 40.1 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
1ce2a897d2f244f4a1f1ffb5dfa0cfd80fbaeb2f30551448de14fd324a9ef60b
|
|
BLAKE2b-256 checksum How to use checksums |
bb1f8a7bc3be9ad8f8265f23e2dcbfa65b7ad65d214914a671aa4f509104ec57
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.16 {"installer":{"name":"uv","version":"0.9.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"AlmaLinux","version":"8.10","id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_aarch64.whl
| Download URL | spu-0.10.0.dev20251208-cp311-none-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 39.9 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
01390c5e0cf1e82ffc7b0620aee90cfcf20787c78dab0793fe922ac843cfc2dc
|
|
BLAKE2b-256 checksum How to use checksums |
28827bc19d22b0c38d72aabf996a2349b6d1d51038c9451b15870cc6db95264c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.16 {"installer":{"name":"uv","version":"0.9.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"CentOS Linux","version":"8","id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / spu-0.10.0.dev20251208-cp311-none-macosx_14_0_arm64.whl
| Download URL | spu-0.10.0.dev20251208-cp311-none-macosx_14_0_arm64.whl |
|---|---|
| Size | 82.9 MB |
| Tags | CPython 3.11 macOS 14.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
a625b3238afbcde71925b350b0ade344dd98f72ea0fbf16ee89306ccaf8307a1
|
|
BLAKE2b-256 checksum How to use checksums |
263f8d0a524cf82a0cc16f07262ff5af19f11a1e65d44078b7ce5dc2ed6b10b8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.16 {"installer":{"name":"uv","version":"0.9.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
