genius-chatbot 0.15.0

Use huggingface models to create an intelligent and scalable chatbot

Genius Chatbot

Version: 0.15.0

Chatbot that uses any desired hugging face model or allows for scalable intelligence based on hardware limitations

Usage:

Short Flag	Long Flag	Description
-h	--help	See Usage
-a	--assimilate	Assimilate knowledge from media provided in directory
-b	--batch-token	Number of tokens per batch
-c	--chunks	Number of chunks to use
-d	--directory	Directory for chromadb and model storage
-e	--embeddings-model	Embeddings model to use
-j	--json	Export to JSON
-p	--prompt	Prompt for chatbot
-q	--mute-stream	Mute stream of generation
-m	--model	Copy GPT4All .bin file from the Model Explorer
-p	--prompt	Prompt for chatbot
-s	--hide-source	Hide source of answer
-t	--max-token-limit	Maximum token to generate
-x	--model-engine	GPT4All or LlamaCPP

Example:

Your very first time running should assimilate up to 3 documents to establish the Chroma Database. This will unlock prompting

genius-chatbot --assimilate "/directory/of/documents"

genius-chatbot --prompt "What is the 10th digit of Pi?"

genius-chatbot  \
    --model "wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin" \
    --prompt "Chatbots are cool because they" \
    --model-engine "GPT4All" \
    --assimilate "/directory/of/documents" \
    --json

Install Instructions

Install Python Package

Windows Prerequisites:

Visual Studio Code 2022

Ubuntu Prerequisites:

apt install -y pandoc

python -m pip install genius-chatbot

Build Instructions

Build Python Package

sudo chmod +x ./*.py
sudo pip install .
python3 setup.py bdist_wheel --universal
# Test Pypi
twine upload --repository-url https://test.pypi.org/legacy/ dist/* --verbose -u "Username" -p "Password"
# Prod Pypi
twine upload dist/* --verbose -u "Username" -p "Password"