Use huggingface models to create an intelligent and scalable chatbot
Project description
Genius Chatbot
Version: 0.16.0
Chatbot that uses any desired hugging face model or allows for scalable intelligence based on hardware limitations
Usage:
Short Flag | Long Flag | Description |
---|---|---|
-h | --help | See Usage |
-a | --assimilate | Assimilate knowledge from media provided in directory |
-b | --batch-token | Number of tokens per batch |
-c | --chunks | Number of chunks to use |
-d | --directory | Directory for chromadb and model storage |
-e | --embeddings-model | Embeddings model to use |
-j | --json | Export to JSON |
-p | --prompt | Prompt for chatbot |
-q | --mute-stream | Mute stream of generation |
-m | --model | Copy GPT4All .bin file from the Model Explorer |
-p | --prompt | Prompt for chatbot |
-s | --hide-source | Hide source of answer |
-t | --max-token-limit | Maximum token to generate |
-x | --model-engine | GPT4All or LlamaCPP |
Example:
Your very first time running should assimilate up to 3 documents to establish the Chroma Database. This will unlock prompting
genius-chatbot --assimilate "/directory/of/documents"
genius-chatbot --prompt "What is the 10th digit of Pi?"
genius-chatbot \
--model "wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin" \
--prompt "Chatbots are cool because they" \
--model-engine "GPT4All" \
--assimilate "/directory/of/documents" \
--json
Install Instructions
Install Python Package
Windows Prerequisites:
Visual Studio Code 2022
Ubuntu Prerequisites:
apt install -y pandoc
python -m pip install genius-chatbot
Build Instructions
Build Python Package
sudo chmod +x ./*.py
sudo pip install .
python3 setup.py bdist_wheel --universal
# Test Pypi
twine upload --repository-url https://test.pypi.org/legacy/ dist/* --verbose -u "Username" -p "Password"
# Prod Pypi
twine upload dist/* --verbose -u "Username" -p "Password"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Close
Hashes for genius_chatbot-0.16.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2b0145a49e2f2834c6ec29de729b140bcc6a4481a861ddd391505d4acba7c1d2 |
|
MD5 | 60837f81d20a49f1df7daabaef802d48 |
|
BLAKE2b-256 | fa05911f13b6c21023b71edace685c1016ac598fa846082fa4049639159b968d |