ESP-PPQ Quantization Tool
ESP-PPQ is a quantization tool based on PPQ, and its source code is fully open-sourced. Built upon PPQ, ESP-PPQ adds Espressif-customized quantizers and exporters, allowing users to select quantization rules compatible with ESP-DL for different chips and export standardized model files that can be directly loaded by ESP-DL. ESP-PPQ is fully compatible with all PPQ APIs and quantization scripts.
For more details on quantization principles, please refer to the PPQ documentation and videos. For instructions on using ESP-PPQ, see How to quantize model.
Installation (安装方法)
-
Install CUDA from CUDA Toolkit
-
Install Complier
apt-get install ninja-build # for debian/ubuntu user
yum install ninja-build # for redhat/centos user
For Windows User:
(1) Download ninja.exe from https://github.com/ninja-build/ninja/releases, add it to Windows PATH.
(2) Install Visual Studio 2019 from https://visualstudio.microsoft.com.
(3) Add your C++ compiler to Windows PATH Environment, if you are using Visual Studio, it should be like "C:\Program Files\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.16.27023\bin\Hostx86\x86"
(4) Update PyTorch version to >=2.0.0.
- Install PPQ
Method 1: Install the package using pip
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
pip install esp-ppq
Method 2: Install from source with pip to stay synchronized with the master branch
git clone https://github.com/espressif/esp-ppq.git
cd esp-ppq
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
pip install -e .
Method 3: Install the package using uv
uv pip install "esp-ppq[cpu]" --torch-backend=cpu
# GPU
# uv pip install "esp-ppq[cpu]" --torch-backend=cu124
# AMD GPU
# uv pip install "esp-ppq[cpu]" --torch-backend=rocm6.2
# Intel XPU
# uv pip install "esp-ppq[cpu]" --torch-backend=xpu
Method 4: Install from source using uv to stay in sync with the master branch
git clone https://github.com/espressif/esp-ppq.git
cd esp-ppq
uv pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
uv pip install -e .
Method 5: Use esp-ppq with docker:
docker build -t esp-ppq:your_tag https://github.com/espressif/esp-ppq.git
[!NOTE]
- The example code installs the Linux PyTorch CPU version. Please install the appropriate PyTorch version based on your actual needs.
- If installing the package with uv, simply modify the
--torch-backendparameter, which will override the PyTorch URLs index configured in the project.
License
This project is distributed under the Apache License, Version 2.0.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file esp_ppq-1.3.10.tar.gz.
File metadata
- Download URL: esp_ppq-1.3.10.tar.gz
- Upload date:
- Size: 488.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.11.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c1b383d2b65a740f58b8d6d39b6c0f5fd122048b8cf4e62e0efa858eee622522
|
|
| MD5 |
1e85ace52b384dbd3128a4333935300e
|
|
| BLAKE2b-256 |
3019713f401f997363928be73e94b43f6d082e9311980ffcc34c45c8192ac991
|
File details
Details for the file esp_ppq-1.3.10-py3-none-any.whl.
File metadata
- Download URL: esp_ppq-1.3.10-py3-none-any.whl
- Upload date:
- Size: 674.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.11.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c6abe31bff425cf3f8522fe827f770edbc4bc3bb4ba2f3f36d71c8c411d85e49
|
|
| MD5 |
ea8e3f53816a8b360e146032c7dc1a57
|
|
| BLAKE2b-256 |
6d7381271857f883b28eb2857fa6b902701794cc9b38567287bd35a0e213a7cc
|
