OnnxSlim: A Toolkit to Help Optimize Onnx Model

These details have not been verified by PyPI

Project links

Project description

OnnxSlim

OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.

🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%
🚀 Rank 1st in the AICAS 2024 LLM inference optimization challenge held by Arm and T-head
🚀 OnnxSlim is merged into ultralytics ❤️❤️❤️
🚀 OnnxSlim is merged into transformers.js 🤗🤗🤗

Installation

Using Prebuilt

pip install onnxslim

Install From Source

pip install git+https://github.com/inisis/OnnxSlim@main

Install From Local

git clone https://github.com/inisis/OnnxSlim && cd OnnxSlim/
pip install .

How to use

onnxslim your_onnx_model slimmed_onnx_model

For more usage, see onnxslim -h or refer to our examples

References

onnx-graphsurgeon

Polygraphy

onnx-simplifier

tabulate

onnxruntime

Contact

Discord: https://discord.gg/nRw2Fd3VUS QQ Group: 873569894

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

This version

0.1.39

Nov 12, 2024

0.1.38

Nov 12, 2024

0.1.37

Nov 10, 2024

0.1.36

Oct 28, 2024

0.1.35

Oct 2, 2024

0.1.34

Sep 13, 2024

0.1.33

Sep 6, 2024

0.1.32

Jul 13, 2024

0.1.31

Jun 22, 2024

0.1.30

Jun 21, 2024

0.1.29.1

Jun 14, 2024

0.1.29

Jun 10, 2024

0.1.28

May 30, 2024

0.1.27

May 28, 2024

0.1.26

May 14, 2024

0.1.25

Apr 28, 2024

0.1.24

Mar 27, 2024

0.1.23

Mar 24, 2024

0.1.22

Mar 16, 2024

0.1.21.1

Mar 14, 2024

0.1.21

Mar 13, 2024

0.1.20

Mar 11, 2024

0.1.19

Mar 9, 2024

0.1.18

Mar 7, 2024

0.1.17

Mar 2, 2024

0.1.16

Jan 27, 2024

0.1.15

Jan 26, 2024

0.1.14.1

Jan 25, 2024

0.1.14

Jan 24, 2024

0.1.13

Jan 2, 2024

0.1.12

Dec 27, 2023

0.1.11

Dec 24, 2023

0.1.10

Dec 21, 2023

0.1.9.1

Dec 19, 2023

0.1.9

Dec 19, 2023

0.1.8

Dec 16, 2023

0.1.7

Dec 3, 2023

0.1.6

Nov 24, 2023

0.1.5

Nov 9, 2023

0.1.4

Nov 2, 2023

0.1.3

Oct 31, 2023

0.1.2

Oct 28, 2023

0.1.1

Oct 23, 2023

0.1.0

Oct 13, 2023

0.0.9

Oct 7, 2023

0.0.8

Sep 18, 2023

0.0.7

Sep 17, 2023

0.0.6

Sep 12, 2023

0.0.5

Sep 11, 2023

0.0.4

Aug 29, 2023

0.0.3

Aug 28, 2023

0.0.2

Aug 28, 2023

0.0.1

Aug 24, 2023

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onnxslim-0.1.39.tar.gz (119.7 kB view details)

Uploaded Nov 12, 2024 Source

Built Distribution

onnxslim-0.1.39-py3-none-any.whl (141.8 kB view details)

Uploaded Nov 12, 2024 Python 3

File details

Details for the file onnxslim-0.1.39.tar.gz.

File metadata

Download URL: onnxslim-0.1.39.tar.gz
Upload date: Nov 12, 2024
Size: 119.7 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for onnxslim-0.1.39.tar.gz
Algorithm	Hash digest
SHA256	`46b647138d62da124aa679935cbce5bde10cf1de494772b56231966fc904c1b8`
MD5	`b67e3f3724a3edebda3c00212af41e1a`
BLAKE2b-256	`286ef74a93b1e077357e42202d1ad8635174f2a7d4c16a0edd590a90f98de09f`

See more details on using hashes here.

File details

Details for the file onnxslim-0.1.39-py3-none-any.whl.

File metadata

Download URL: onnxslim-0.1.39-py3-none-any.whl
Upload date: Nov 12, 2024
Size: 141.8 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for onnxslim-0.1.39-py3-none-any.whl
Algorithm	Hash digest
SHA256	`3d4a47563b36201ce5e886e19cc99c872f8d1e04eeb76b952616f5946b82aa53`
MD5	`4ff6509c7340ed5b4d6ea36384949fdb`
BLAKE2b-256	`0c893b9acb813e7c520a5aa8c2edba48bb4bc07410e7110a7357c93970ca7001`