cgg is a short form of call gguf model/file; cgg is a cmd-based app built on gguf-connector, which allows users interacting with large language model (i.e., chatgpt) via a simple command without coding a long long syntax
Project description
GGUF caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3 (once only):
pip install cgg
update the caller (if not in the latest version) by:
pip install cgg --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
cgg -h
check current version
cgg -v
connector menu
cgg menu
graphical user interface (GUI) caller
Simple GUI to interact with a chat model for generating responses (recommended).
call cpp connector:
cgg cpp
call c connector:
cgg c
command line interface (CLI) caller
CLI input also provided for expert/advanced user(s).
call gpp connector:
cgg gpp
call g connector:
cgg g
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
clone feature
cgg clone [url]
With this fast clone feature, you can clone any (GGUF model) file from URL, save it automatically in the current directory, and get it ready to connect locally (run it with your own machine offline); depends on the file size, as well as the network connectivity, it may take a while to complete the clone process; and you can see a dynamic progress bar showing the downloading status in this latest version. (an universal issue was detected for mac users: ssl cert. verify failed; possible solution: click Install Certificates.command under your Python version folder; details please refer to issues reported)
sample model list
cgg s
Opt a sample GGUF from the lazy list (download ready) or use the above clone feature as below.
sample model(s) available to download (try out)
For general purpose [chat.gguf] (size: around 2GB or less)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
For coding [code.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/code.gguf
For health/medical advice [medi.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.