Skip to main content

GGUF Caller

Project description

GGUF model caller

This package is a GGUF (GPT-Generated Unified Format) file/model caller.

install the caller via pip/pip3 (once only):

pip install callgg

update the caller (if not in the latest version) by:

pip install callgg --upgrade

user manual

This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.

callgg -h

Graphical User Interface (GUI) caller

A basic GUI to interact with a chat model for generating responses (recommanded).

call cpp connector:

callgg cpp

call c connector:

callgg c

Command Line Interface (CLI) caller

A simple CLI input also provided for expert/advanced user(s).

call gpp connector:

callgg gpp

call g connector:

callgg g

GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown as below.

sample model(s) available to download (try out)

For general purpose https://huggingface.co/calcuis/chat/blob/main/chat.gguf

For coding https://huggingface.co/calcuis/code_mini/blob/main/code.gguf

For health/medical advice https://huggingface.co/calcuis/medi_mini/blob/main/medi.gguf

***those are all experimental models; no guarantee on quality

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

callgg-0.2.2.tar.gz (2.8 kB view hashes)

Uploaded Source

Built Distribution

callgg-0.2.2-py2.py3-none-any.whl (3.4 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page