Skip to main content

GGUF selector

Project description

GGUF selector

Static Badge

This package is a simple graphical user interface (GUI) application that uses the llama.cpp to interact with a chat model for generating responses.

include the module in your code

from gguf_selector import connector

You could pull any (pre-trained model) GGUF file(s) inside the folder and it will automatically be detected by the program.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page