Skip to main content

Deep learning package to add chat capabilities to OpenBB

Project description

OpenBB Chat

X Follow Us Badge Discord Badge Docker Badge

PyTorch Lightning Config: Hydra Models: HuggingFace


OpenBB Chat provides chat capabilities to OpenBB by leveraging the generative potential of LLMs. The chat is implemented following InstructGPT. This repository contains the implementations of the NLP models and the training/inference infraestructure.



# clone project
git clone
cd openbb-chat

# install pdm
pip install pdm

# install package
pdm install

How to run

Train model with default configuration

# train demo on CPU
python openbb_chat/ trainer=cpu

# train demo on GPU
python openbb_chat/ trainer=gpu

Train model with chosen experiment configuration from configs/experiment/

python openbb_chat/ experiment=experiment_name.yaml

You can override any parameter from command line like this

python openbb_chat/ trainer.max_epochs=20 data.batch_size=64

Released models

The model Griffin-3B-GPTQ has been created as part of this project by quantizing Griffin-3B. In the future, more models will be trained and released as needed.

Sample usage with pre-trained models

In the repository openbb-chat is used to perform retrieval-augmented generation (RAG) with OpenBB's official documentation and pre-trained models. In particular, the classifiers modules are used to find the appropriate function in OpenBB and the llms modules are used to complete the function call.


The Dockerfile is based on the image nvidia/cuda, which states that the following notice must be included: This software contains source code provided by NVIDIA Corporation.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openbb_chat-0.0.11.post1.tar.gz (134.4 kB view hashes)

Uploaded Source

Built Distribution

openbb_chat-0.0.11.post1-py3-none-any.whl (27.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page