a simple way to interact llama with gguf file(s)
Project description
GGUF core
This package is a GGUF (GPT-Generated Unified Format) file caller.
install the caller via pip/pip3 (once only):
pip install gguf-core
update the caller (if not in the latest version) by:
pip install gguf-core --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
gguf -h
check current version
gguf -v
cli connector
gguf c
gui connector
gguf g
GGUF file(s) in the same directory will automatically be detected by the caller.
clone feature
gguf clone [url]
sample model list
You can either use the clone feature above or opt a sample GGUF straight from the sample list by:
gguf s
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gguf_core-0.0.5.tar.gz
(5.5 kB
view hashes)
Built Distribution
Close
Hashes for gguf_core-0.0.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9fcc38bbf2c29605d3e96036fd6b2c891037619df2747f323d6b79807a59e030 |
|
MD5 | ed53a4cc39573d5eb571269cb0f63e5a |
|
BLAKE2b-256 | 39feb19827fa949b0b518abbfafdc5679c0f0b33d88af71a2889dbfbc1ae68a0 |