GGUF selector
Project description
GGUF selector
This package is a simple graphical user interface (GUI) application that uses the llama.cpp to interact with a chat model for generating responses.
include the module in your code
from gguf_selector import connector
You could pull any (pre-trained model) GGUF file(s) inside the folder and it will automatically be detected by the program.
sample model(s) available to download (try out)
For general purpose https://huggingface.co/calcuis/chat/blob/main/chat.gguf
For coding https://huggingface.co/calcuis/code_mini/blob/main/code.gguf
For health/medical advice https://huggingface.co/calcuis/medi_mini/blob/main/medi.gguf
***those are all experimental models; no guarantee on quality
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gguf_selector-0.0.2.tar.gz
(3.9 kB
view hashes)
Built Distribution
Close
Hashes for gguf_selector-0.0.2-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc95ee9d89a93ce802d1ff562ce0e289dae25147f896ee7ad041f0cb62c593bb |
|
MD5 | 445ff2fd2ff3d5d9ab059c218ffc6dfa |
|
BLAKE2b-256 | 12a9093c7c7d7a36d12818f1c6fd68030159bbe7c2ad13df86ed709fba03f5ce |