a simple way to interact llama with gguf
Project description
GGUF core
This package is a GGUF (GPT-Generated Unified Format) file caller.
install the caller via pip/pip3 (once only):
pip install gguf-core
update the caller (if not in the latest version) by:
pip install gguf-core --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
gguf -h
check current version
gguf -v
cli connector
with command-line interface
gguf c
gui connector
with graphical user interface
gguf g
interface selector
selection menu for connector interface(s) above
gguf i
metadata reader
read model metadata for detail(s)
gguf r
or try model analyzor (beta)
gguf a
GGUF file(s) in the current directory will automatically be detected by the caller.
get feature
get GGUF from URL; clone/download it to the current directory
gguf get [url]
sample model list
You can either use the get feature above or opt a sample GGUF straight from the sample list by:
gguf s
pdf analyzor (beta)
You can now load your PDF file(s) straight into the model for generating digested summary; try it out by:
gguf p
wav analyzor (offline)
You can speak/talk straight to GGUF right away; prompt WAV(s) into the model for feedback; try it out by:
gguf f
wav analyzor (online)
more accurate (via google Open api); Internet access needed; try it out by:
gguf o
launch to page/container (gguf.io)
gguf io
launch to page/container (gguf.us)
gguf us
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gguf_core-0.0.43-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | deb831b68d5a99b822d48567ede9f8bd4c6abb75dc2f9994d4cb4d7789af23af |
|
MD5 | 58d1b1193305183e139af2b1b5ee41c1 |
|
BLAKE2b-256 | b580bf6b3fa14ac3f3f007bc4b7a58edf384f99939064dbe543f2bc91c80fdc3 |