gguf-connector 0.3.1

GGUF connector(s) with GUI

GGUF Connector

GGUF (GPT-Generated Unified Format) is a successor of GGML (GPT-Generated Model Language), it was released on August 21, 2023; by the way, GPT stands for Generative Pre-trained Transformer.

This package is a simple graphical user interface (GUI) application that uses the ctransformers or llama.cpp to interact with a chat model for generating responses.

Install the connector via pip (once only):

pip install gguf-connector

Include the connector by:

import gguf_connector 

Pull any (pre-trained model) GGUF file(s) along with the Python code and it will automatically be detected by the module.

With this version, you can even choose which connector (either ctransformers or llama.cpp) to be used at the very beginning.

For a standalone lazy version please refer to the repository in the reference list (below).

Reference

https://github.com/calcuis/chatgpt-model-selector