GGUF connector(s) with GUI
Project description
GGUF Connector
GGUF (GPT-Generated Unified Format) is a successor of GGML (GPT-Generated Model Language), it was released on August 21, 2023; by the way, GPT stands for Generative Pre-trained Transformer.
This package is a simple graphical user interface (GUI) application that uses the ctransformers or llama.cpp to interact with a chat model for generating responses.
Install the connector via pip (once only):
pip install gguf-connector
Update the connector (if previous version installed) by:
pip install gguf-connector --upgrade
With this version, you can interact straight with the GGUF file(s) available in the same directory by a simple command.
Graphical User Interface (GUI)
Select model(s) with ctransformers connector:
gguf-c
Select model(s) with llama.cpp connector:
gguf-cpp
Command Line Interface (CLI)
Select model(s) with ctransformers connector:
gguf-g
Select model(s) with llama.cpp connector:
gguf-gpp
You can even choose which connector (either ctransformers or llama.cpp) to be used at the very beginning.
Include/import the connector selection menu to the code by:
from gguf_connector import __main__
For standalone version please refer to the repository in the reference list (below).
Reference
Resources
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gguf_connector-0.3.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 106fd839ed1af1c0e4b25b4fbab9b7b75fa943d45f0c88bfaabd7bf6497dc4d6 |
|
MD5 | e98a14bff6d58c67a8ac2f693f6ce845 |
|
BLAKE2b-256 | 5d09764933a4e3856afb44c861f3b3895395100ee29ddbe906505df56e875ee7 |