GGUF connector(s) with GUI
Project description
GGUF connector
GGUF (GPT-Generated Unified Format) is a successor of GGML (GPT-Generated Model Language), it was released on August 21, 2023; by the way, GPT stands for Generative Pre-trained Transformer.
This package is a simple graphical user interface (GUI) application that uses the ctransformers or llama.cpp to interact with a chat model for generating responses.
Install the connector via pip (once only):
pip install gguf-connector
Update the connector (if previous version installed) by:
pip install gguf-connector --upgrade
With this version, you can interact straight with the GGUF file(s) available in the same directory by a simple command.
Graphical User Interface (GUI)
Select model(s) with llama.cpp connector:
ggc cpp
Select model(s) with ctransformers:
ggc c
Command Line Interface (CLI)
Select model(s) with ctransformers:
ggc g
Select model(s) with llama.cpp connector:
ggc gpp
Metadata reader (CLI only)
Select model(s) with metadata reader:
ggc r
PDF analyzor (beta feature on CLI recently)
Load PDF(s) into a model with ctransformers:
ggc cp
Load PDF(s) into a model with llama.cpp connector:
ggc pp
Speech recognizor (beta feature; accept WAV format recently)
Prompt WAV(s) into a model with ctransformers:
ggc cs
Prompt WAV(s) into a model with llama.cpp connector:
ggc ps
Container
Launch to page/container:
ggc w
Menu
Enter the main menu for selecting a connector or getting pre-trained trial model(s).
ggc m
Import as a module
Include the connector selection menu to your code by:
from gguf_connector import menu
For standalone version please refer to the repository in the reference list (below).
References
model selector (standalone version: installable package)
cgg (cmd-based tool)
Resources
Website
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gguf_connector-0.7.28-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ae5ebae4b38ee6ac6025f33adf479890c522bab3d8824a617491d1a00d33068 |
|
MD5 | 8ae6620b94509ff9ceb80a6075ca96a3 |
|
BLAKE2b-256 | 5e681c2fbaca523ecd4472f24a878dd209b556e0f20f5e856697a2cee5126aa8 |