cutter/quantizor for gguf (bf/f16)
Project description
cutter/quantizor for gguf
install it via pip/pip3
pip install gguf-cutter
download the cutter by (if no py command; use python/python3 instead)
py -m gguf_cutter
how to use it
tag: q2_k, q3_k_s, q3_k_m, q3_k_l, q4_k_s, q4_k_m, q5_k_s, q5_k_m, q6_k, q5_0, q5_1, q4_0, q4_1, q8_0
.\quantizor.exe input_path output_path tag
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gguf_cutter-0.0.1.tar.gz
(2.3 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file gguf_cutter-0.0.1.tar.gz.
File metadata
- Download URL: gguf_cutter-0.0.1.tar.gz
- Upload date:
- Size: 2.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cf67a6b707c34948677d9e38a74ca852f9982212301bc01e7a925a5aecd8997c
|
|
| MD5 |
ed2ad09abd2e0312b6260ff490149986
|
|
| BLAKE2b-256 |
902243af212bfce89bccd5f0c4ba965a91245ff5255c09812d397156cc77e68f
|
File details
Details for the file gguf_cutter-0.0.1-py2.py3-none-any.whl.
File metadata
- Download URL: gguf_cutter-0.0.1-py2.py3-none-any.whl
- Upload date:
- Size: 2.9 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
98a8b302c9141e60cc64335e0b0666d8b727fa76658ae77b8629513ef783fecb
|
|
| MD5 |
2fbaeae25eade2e265b5b95a5e51ec52
|
|
| BLAKE2b-256 |
9a39ce64757ea6705541faa59675196e904019eedc8775286204ecd1f0a8d588
|
