cgg is a short form of call gguf model/file; cgg is a cmd-based app built on gguf-connector, which allows users interacting with large language model (i.e., chatgpt) via a simple command without coding a long long syntax
Project description
GGUF caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3 (once only):
pip install cgg
update the caller (if not in the latest version) by:
pip install cgg --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
cgg -h
check current version
cgg -v
connector menu
cgg menu
graphical user interface (GUI) caller
Simple GUI to interact with a chat model for generating responses (recommended).
call cpp connector:
cgg cpp
call c connector:
cgg c
command line interface (CLI) caller
CLI input also provided for expert/advanced user(s).
call gpp connector:
cgg gpp
call g connector:
cgg g
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
new feature: cgg clone [URL]
With this feature, you can clone any GGUF model/file from an URL, save it in the current directory, and ready to connect it locally (run in your own machine).
sample model(s) available to download (try out)
For general purpose https://huggingface.co/calcuis/chat/blob/main/chat.gguf (size: around 2GB or less)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
For coding https://huggingface.co/calcuis/code_mini/blob/main/code.gguf (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/code.gguf
For health/medical advice https://huggingface.co/calcuis/medi_mini/blob/main/medi.gguf (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.