Deep learning package to add chat capabilities to OpenBB
Project description
Description
OpenBB Chat provides chat capabilities to OpenBB by leveraging the generative potential of LLMs. The chat is implemented following InstructGPT. This repository contains the implementations of the NLP models and the training/inference infraestructure.
Installation
PDM
# clone project
git clone https://github.com/Dedalo314/openbb-chat
cd openbb-chat
# install pdm
pip install pdm
# install package
pdm install
How to run
Train model with default configuration
# train demo on CPU
python openbb_chat/train.py trainer=cpu
# train demo on GPU
python openbb_chat/train.py trainer=gpu
Train model with chosen experiment configuration from configs/experiment/
python openbb_chat/train.py experiment=experiment_name.yaml
You can override any parameter from command line like this
python openbb_chat/train.py trainer.max_epochs=20 data.batch_size=64
Released models
The model Griffin-3B-GPTQ has been created as part of this project by quantizing Griffin-3B. In the future, more models will be trained and released as needed.
Sample usage with pre-trained models
In the repository https://github.com/GPTStonks/api openbb-chat
is used to perform retrieval-augmented generation (RAG) with OpenBB's official documentation and pre-trained models. In particular, the classifiers
modules are used to find the appropriate function in OpenBB and the llms
modules are used to complete the function call.
License
The Dockerfile is based on the image nvidia/cuda
, which states that the following notice must be included: This software contains source code provided by NVIDIA Corporation.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for openbb_chat-0.0.11-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 90bb562c84e04954acc706ac1e699410126719a1322e179e5670e86eb63c8e53 |
|
MD5 | 97b55b94ed1d3170970934d1c024b566 |
|
BLAKE2b-256 | ec95bcc6ab5d5246cc52ff96ec0049a87ce279687dcc8f1333dbd8edaa32ea7e |