Call GGUF Model
Project description
GGUF model caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3:
pip install callgg
User manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
callgg -h
call cpp connector:
callgg cpp
call c connector:
callgg c
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown as below.
sample model(s) available to download (try out)
For general purpose https://huggingface.co/calcuis/chat/blob/main/chat.gguf
For coding https://huggingface.co/calcuis/code_mini/blob/main/code.gguf
For health/medical advice https://huggingface.co/calcuis/medi_mini/blob/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
callgg-0.1.tar.gz
(4.8 kB
view hashes)