Model Compression Toolkit (MCT) Quantizers
The MCT Quantizers library is an open-source library developed by researchers and engineers working at Sony Semiconductor Israel.
It provides tools for easily representing a quantized neural network in both Keras and PyTorch. The library offers researchers, developers, and engineers a set of useful quantizers, along with a simple interface for implementing new custom quantizers.
High level description:
The library's quantizers interface consists of two main components:
QuantizationWrapper: This object takes a layer with weights and a set of weight quantizers to infer a quantized layer.ActivationQuantizationHolder: An object that holds an activation quantizer to be used during inference.
Users can set the quantizers and all the quantization information for each layer by initializing the weights_quantizer and activation_quantizer API.
Please note that the quantization wrapper and the quantizers are framework-specific.
Quantizers:
The library provides the "Inferable Quantizer" interface for implementing new quantizers.
This interface is based on the BaseInferableQuantizer class, which allows the definition of quantizers used for emulating inference-time quantization.
On top of BaseInferableQuantizer the library defines a set of framework-specific quantizers for both weights and activations:
The mark_quantizer Decorator
The @mark_quantizer decorator is used to assign each quantizer with static properties that define its task compatibility. Each quantizer class should be decorated with this decorator, which defines the following properties:
QuantizationTarget: An Enum that indicates whether the quantizer is intended for weights or activations quantization.QuantizationMethod: A list of quantization methods (Uniform, Symmetric, etc.).identifier: A unique identifier for the quantizer class. This is a helper property that allows the creation of advanced quantizers for specific tasks.
Getting Started
This section provides a quick guide to getting started. We begin with the installation process, either via source code or the pip server. Then, we provide a short example of usage.
Installation
From PyPi - mct-quantizers package
To install the latest stable release of MCT Quantizer from PyPi, run the following command:
pip install mct-quantizers
If you prefer to use the nightly package (unstable version), you can install it with the following command:
pip install mct-quantizers-nightly
From Source
To work with the MCT Quantizers source code, follow these steps:
git clone https://github.com/sony/mct_quantizers.git
cd mct_quantizers
python setup.py install
Requirements
To use MCT Quantizers, you need to have one of the supported frameworks, Tensorflow or PyTorch, installed.
For use with Tensorflow, please install the following package: tensorflow,
For use with PyTorch, please install the following package: torch
You can also use the requirements file to set up your environment.
License
2 maintainers
Metadata
2 maintainers
Release files for mct-quantizers-nightly 1.4.0.20240220.post1007
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| mct-quantizers-nightly-1.4.0.20240220.post1007.tar.gz | 40.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| mct_quantizers_nightly-1.4.0.20240220.post1007-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 137.3 kB
Release files / mct-quantizers-nightly-1.4.0.20240220.post1007.tar.gz
| Download URL | mct-quantizers-nightly-1.4.0.20240220.post1007.tar.gz |
|---|---|
| Size | 40.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
aafbe17f365aeb96a28422de4ffb90eed78fb8bdc46d196e3740f1a5746a52b9
|
|
BLAKE2b-256 checksum How to use checksums |
73d1210af16a2875bce29f7038e0ff70ebbc27df636fee3678f2f4086a7fa873
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.18
|
Release files / mct_quantizers_nightly-1.4.0.20240220.post1007-py3-none-any.whl
| Download URL | mct_quantizers_nightly-1.4.0.20240220.post1007-py3-none-any.whl |
|---|---|
| Size | 96.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1375c12982cb3974738de27f9c04b2234ac0996cf583f96447a366ba2016ae66
|
|
BLAKE2b-256 checksum How to use checksums |
3c422718706638fb50455375e7786f0a4ee39194e7cb8bb26b767883cdd87204
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.18
|
