nlp-models 4.1.0

Transformers based NLP models

NLP Models

A repository for building transformer based nlp models

Run Llama2 on consumer CPU

Run Chat UI on CPU

cd pipelines/nlp_models/
streamlit run app.py

Run Chat cmd line on CPU

llm_app chat -s 'hi there'

Models

1. bert_classifier A wrapper package around BERT-based classification models

   • Training example
   • Inference example

2. multi_task_model An implementation of multi-tasking model built on encoder models

   • Zero-shot multi-task model
   • Training example
   • Inference example
   • Qqrant Vector DB

3. GPT-2

• Training GPT-2 model

4. Falcon 7B

• Running Falcon 7b model

5. Quantized Llama2 models

• Run Llama2 chat on CPU
• Run Llama2 QA on a custom pdf document on CPU

Installation

Install from PyPi

pip install nlp-models

Install from source

git clone [e-mail]:minggnim/nlp-models.git
pip install -r requirements