Write ML models in GGUF for GGML
Project description
gguf
This is a Python package for writing binary files in the GGUF (GGML Universal File) format.
See convert-llama-hf-to-gguf.py as an example for its usage.
Install
pip install gguf
Development
Maintainers who participate in development of this package are advised to install it in editable mode:
cd /path/to/llama.cpp/gguf
pip install --editable .
Note: This may require to upgrade your Pip installation, with a message saying that editable installation currently requires setup.py
.
In this case, upgrade Pip to the latest:
pip install --upgrade pip
TODO
- Add tests
- Include conversion scripts as command line entry points in this package.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gguf-0.1.0.tar.gz
(7.8 kB
view hashes)
Built Distribution
gguf-0.1.0-py3-none-any.whl
(7.9 kB
view hashes)