cgg is a short form of call gguf model/file; cgg is a cmd-based app built on gguf-connector, which allows users interacting with large language model (i.e., chatgpt) via a simple command without coding a long long syntax
Project description
GGUF caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3 (once only):
pip install cgg
update the caller (if not in the latest version) by:
pip install cgg --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
cgg -h
check current version
cgg -v
connector menu
cgg menu
graphical user interface (GUI) caller
Simple GUI to interact with a chat model for generating responses (recommended).
call cpp connector:
cgg cpp
call c connector:
cgg c
command line interface (CLI) caller
CLI input also provided for expert/advanced user(s).
call gpp connector:
cgg gpp
call g connector:
cgg g
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
clone feature
cgg clone [url]
With this fast clone feature, you can clone any GGUF model/file from URL, save it automatically in the current directory, and get it ready to connect locally (run it with your own machine offline); depends on the file size, as well as the network connectivity, it may take a while to complete the clone process; and you can see a dynamic progress bar showing the downloading status in this latest version. (an universal issue was detected for mac users: ssl cert. verify failed; possible solution: click Install Certificates.command under your Python version folder; details please refer to issues reported)
sample model list
cgg s
Opt a sample GGUF from the lazy list (download ready) or use the above clone feature as below.
sample model(s) available to download (try out)
For general purpose [chat.gguf] (size: around 2GB or less)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
For coding [code.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/code.gguf
For health/medical advice [medi.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.