OnnxSlim: A Toolkit to Help Optimize Large Onnx Model
Project description
OnnxSlim
OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.
- 🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%
Installation
Using Prebuilt
pip install onnxslim
Build From Source
pip install .
How to use
onnxslim your_onnx_model slimmed_onnx_model
For more usage, see onnxslim -h or refer to our examples
References
Contact
Discord: https://discord.gg/nRw2Fd3VUS
QQ Group: 873569894
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
onnxslim-0.1.23.tar.gz
(90.7 kB
view hashes)
Built Distribution
onnxslim-0.1.23-py3-none-any.whl
(101.7 kB
view hashes)
Close
Hashes for onnxslim-0.1.23-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2890e6cd815acdbb232062bbe0a2d9d65aa7a03eae9a7c4a118ce70df94863c8 |
|
MD5 | b8fc6cd56df7b62f96d2f19908aa936b |
|
BLAKE2b-256 | 96c100ae4c0f937e2efd7e3cb121d7b2b5935e24fdd868492822333edd678d02 |