Qwodel
Production-grade model quantization SDK for AWQ, GGUF, and CoreML.
Installation
# Pick the backend you need
pip install qwodel[gguf] # CPU quantization
pip install qwodel[awq] # GPU quantization (requires CUDA)
pip install qwodel[coreml] # Apple devices
pip install qwodel[all] # Everything
Quick Example
from qwodel import Quantizer
output = Quantizer(
backend="gguf",
model_path="meta-llama/Llama-2-7b-hf",
output_dir="./quantized"
).quantize(format="Q4_K_M")
print(f"Saved to: {output}")
Documentation
Full documentation — guides, API reference, CLI reference, and examples — is at:
Contributing
See CONTRIBUTING.md.
License
Qwodel Community License v1.0 — see LICENSE.
Acknowledgments
Built on top of llama.cpp, llm-compressor, and CoreMLTools.
1 maintainer
Release files for Qwodel 1.4.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| qwodel-1.4.0.tar.gz | 213.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| qwodel-1.4.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 424.6 kB
Release files / qwodel-1.4.0.tar.gz
| Download URL | qwodel-1.4.0.tar.gz |
|---|---|
| Size | 213.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
56312c985db6ff1c6c19dae4d6d334a56e7e3c64ccdf0a5e56c38fcdee5eee81
|
|
BLAKE2b-256 checksum How to use checksums |
7d2e2e138799789794be2fe0ab5a9e3dd47acabdc47a73375b437970768b9534
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.12
|
Release files / qwodel-1.4.0-py3-none-any.whl
| Download URL | qwodel-1.4.0-py3-none-any.whl |
|---|---|
| Size | 211.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
5c26a2f9795b509871a7e7f7dcc1eef394900a2ea7e306965883cb9d4d51bc1d
|
|
BLAKE2b-256 checksum How to use checksums |
8271511e453eb3f256ace2d6725a14a3a2ea5a4e190d7d0595d015f60169ece3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.12
|
