scarabs 0.0.1

scarab: llm training paradigm

scarab: a universal training framework

core:

• Training of tabular data, For example, CTR used in recommendation systems
• Training of text data, For example, text classification
• Training of image data, For example, image classification
• Training of LLM, For example, llm pretrain

very easy to use

pip install scarab

In detail

1. Tabular Data You can refer to tabular_ctr in the examples folder

2. Text Data You can refer to llm_classification in the examples folder

3. LLM You can refer to llm_pretrain in the examples folder