Chat AI: A chatbot framework
Project description
Chat AI: Run LLMs with your own hardware
Chat AI is an interface that sits on top of a custom engine which is responsible for processing requests and responses to and from an active Google T5-Flan model.
Bundled Installation
Official Build can be acquired here for those who want to use a compiled version of Chat AI without having to install any additional requirements
Development
Prerequisites
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
Pypi installation
Use this installation method if you intend to use Chat AI from the command line or with other python libraries or scripts.
pip install chatairunner
pip install git+https://github.com/w4ffl35/diffusers.git@ckpt_fix
pip install git+https://github.com/w4ffl35/transformers.git@tensor_fix
Development installation
Use this installation method if you intend to modify the source code of Chat AI.
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
- Fork this repo on github
git clone https://github.com/Capsize-Games/chatai
python -m venv env
- skip if you don't want to use venvcd chatai && pip install -e .
cd chatai && python main.py
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
chatairunner-1.0.6.tar.gz
(14.3 kB
view hashes)
Built Distribution
Close
Hashes for chatairunner-1.0.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2b79159b42fc5b2e904b62245209d3c6bc2a1ce87a9f096e3098400514cfebd2 |
|
MD5 | 6a427f6c59d48a7870d0a6cbbc0254d8 |
|
BLAKE2b-256 | 5a7d5d1265dc0bf2aec52152afd0b3b8a21309d35349e65c4c4b1979f18cfb7e |