GGUF caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller. Perfect to run in low end device(s).
install the caller via pip/pip3 (once only):
pip install cgg
If your c/c++ compiler cannot build the engine wheel successfully; could opt to get it here straight; or try core.
update the caller (if not in the latest version) by:
pip install cgg --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
cgg -h
check current version
cgg -v
connector menu
cgg menu
graphical user interface (GUI) caller
Simple GUI to interact with a chat model for generating responses (recommended).
call cpp connector:
cgg cpp
call c connector:
cgg c
command line interface (CLI) caller
CLI input also provided for expert/advanced user(s).
call gpp connector:
cgg gpp
call g connector:
cgg g
call v connector:
cgg v
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
metadata reader:
You can check model metadata by:
cgg r
Or try the model analyzor by:
cgg a
divider:
Divide selected model into different part(s) by:
cgg d
merger:
Merge all gguf in the current directory by:
cgg m
clone feature
cgg clone [url]
With this fast clone feature, you can clone any (GGUF model) file from URL, save it automatically in the current directory, and get it ready to connect locally (run it with your own machine offline); depends on the file size, as well as the network connectivity, it may take a while to complete the clone process; and you are able to see a dynamic progress bar showing the downloading status.
If you are a mac newbie, you might encounter ssl cert. issue while executing clone command or while entering the lazylist below; a practical solution: click Install Certificates.command under your Python version folder; details please refer to the issues reported.
sample model(s) available to download (try out)
For general purpose [chat.gguf] (size: around 2GB or less)
cgg clone https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
For coding assistance [code.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/code_mini/resolve/main/code.gguf
For health/medical advice [medi.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/medi_mini/resolve/main/medi.gguf
For law/legal opinion [law.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/law_mini/resolve/main/law.gguf
For wealth/financial plan [finance.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/gguf/resolve/main/finance.gguf
For calculation/math solution [math.gguf] (size: around 3GB or more)
cgg clone https://huggingface.co/calcuis/gguf/resolve/main/math.gguf
***those are all experimental models; no guarantee on quality
sample model list
You can either use the clone feature above or opt it straight from the lazy list by:
cgg s
gguf pack
Download gguf windows portable pack by:
cgg p
comfy gguf pack
Download comfy GGUF windows portable pack by:
cgg y
gguf node
Download node for comfyui by:
cgg n
prompt generator
Generate random bulk prompt(s) and save it in separate text file(s) by:
cgg pg
0.001% duplicate rate approximately; opt to use cleansor to remove it
pdf analyzor (beta)
You can load PDF into the model for analysis right away by (analyzor c):
cgg pc
Or by (analyzor p):
cgg pp
voice/speech recognizor (beta)
You can prompt voice/speech (wav file) as input by (recognizor c):
cgg vc
Or by (recognizor p):
cgg vp
Or by (online recognizor c):
cgg oc
Or by (online recognizor p):
cgg op
image/video generator (beta)
Generate image from text input (t2i) by:
cgg t2i
Generate video from text input (t2v) by:
cgg t2v
Generate video from image and/or text input (i2v) by:
cgg i2v
image/video/audio connector
Flux model connector
cgg flux
Qwen image connector
cgg qwen
Image edit connector
cgg edit
Wan video connector
cgg wan
Ltxv model connector
cgg ltxv
Mochi connector
cgg mochi
Docling connector
cgg docling
Fastvlm connector
cgg fastvlm
Vibevoice connector
cgg vibevoice
Gudio connector
cgg gudio
website
Click gguf.org (mirror of gguf.us) or launch it straight from console by:
cgg org
Click gguf.io (mirror of gguf.us) or launch it straight from console by:
cgg io
Click gguf.us or launch it straight from console by:
cgg us
gk
cgg gk
1 maintainer
Metadata
1 maintainer
Release files for cgg 0.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| cgg-0.5.0.tar.gz | 7.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| cgg-0.5.0-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details |
Total release size: 14.2 kB
Release files / cgg-0.5.0.tar.gz
| Download URL | cgg-0.5.0.tar.gz |
|---|---|
| Size | 7.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d93d55e425b2e00336e2cb20c27ea0b575d14a970729cf55de817a6711864ef1
|
|
BLAKE2b-256 checksum How to use checksums |
475263eefc8515aaa90a2e38698dec2edf598d366cbeef2561aab854fbe8550e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.9
|
Release files / cgg-0.5.0-py2.py3-none-any.whl
| Download URL | cgg-0.5.0-py2.py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
a0d87ef8bcebd1bac6c29fba9d19da3effc9ef4bb47ae35584200a42af517f0d
|
|
BLAKE2b-256 checksum How to use checksums |
62bf3589840dfa0873d6ae43bfe3f15bf5dd44828b8b0d92eaf8e055d75aac8d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.9
|
