GGUF caller
Project description
GGUF model caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3 (once only):
pip install callgg
update the caller (if not in the latest version) by:
pip install callgg --upgrade
new feature(s) in the latest version
Connector selection menu and flag -v or --version
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
callgg -h
graphical user interface (GUI) caller
A basic GUI to interact with a chat model for generating responses (recommended).
call cpp connector:
callgg cpp
call c connector:
callgg c
command line interface (CLI) caller
A simple CLI input also provided for expert/advanced user(s).
call gpp connector:
callgg gpp
call g connector:
callgg g
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
sample model(s) available to download (try out)
For general purpose https://huggingface.co/calcuis/chat/blob/main/chat.gguf
For coding https://huggingface.co/calcuis/code_mini/blob/main/code.gguf
For health/medical advice https://huggingface.co/calcuis/medi_mini/blob/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for callgg-0.2.6-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a4d01059b86d0cb398ddb75332ff0b581db35e348ba948d8f4bc77b2464c0087 |
|
MD5 | 13d8af9d3d6ca13f6cd7ff19a271e795 |
|
BLAKE2b-256 | b8496ed5c174f67dd2c3094d4a571a4170923e7b38671410da36acc2d2c47fe4 |