GGUF caller
Project description
GGUF model caller
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
install the caller via pip/pip3 (once only):
pip install callgg
update the caller (if not in the latest version) by:
pip install callgg --upgrade
user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
callgg -h
call gguf-selector for running a GGUF model/file:
callgg run
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
save feature
callgg save [url]
You might need the ssl certificate to make this feature works; install it by: pip install certifi
if you don't have;
or you can upgrade your llama-core by: pip install llama-core --upgrade
then it will come with those packages (certificate, new loading bar module, etc.)
sample model(s) available to download (try out)
For general purpose [chat.gguf] (file size: around 2GB or less)
callgg save https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
For coding assistance [code.gguf] (file size: around 3GB or more)
callgg save https://huggingface.co/calcuis/code_mini/resolve/main/code.gguf
For health/medical advice [medi.gguf] (file size: around 3GB or more)
callgg save https://huggingface.co/calcuis/medi_mini/resolve/main/medi.gguf
For law/legal opinion [law.gguf] (size: around 3GB or more)
callgg save chttps://huggingface.co/calcuis/law_mini/resolve/main/law.gguf
For wealth/financial plan [finance.gguf] (size: around 3GB or more)
callgg save https://huggingface.co/calcuis/gguf/resolve/main/finance.gguf
***those are all experimental models; no guarantee on quality
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for callgg-1.0.3-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d606cdb668ec59ab3a08a146edbc8bd3575afdfe89aaf3739cab2fe8c549c07 |
|
MD5 | 6d09df3c08462adc85060743fbbe0cf6 |
|
BLAKE2b-256 | 588f6762a745367a09d8946e2a78bee0007e6ee01b78238b4c7a815b508f2eb6 |