nlp-models 4.0.1

Transformers based NLP models

NLP Models

A repository for building transformer based nlp models

Run Llama2 Chat UI on CPU

cd pipelines/nlp_models/
streamlit run app.py

Models

1. bert_classifier A wrapper package around BERT-based classification models

   • Training example
   • Inference example

2. multi_task_model An implementation of multi-tasking model built on encoder models

   • Zero-shot multi-task model
   • Training example
   • Inference example
   • Qqrant Vector DB

Other Example Notebooks

• Training GPT-2 model
• Running Falcon 4b model
• Run Llama2 chat on cpu

Installation

Install from PyPi

pip install nlp-models

Install from source

git clone [e-mail]:minggnim/nlp-models.git
pip install -r requirements