scarabs 0.0.4

scarab: llm training paradigm

scarabs: a universal training framework

core:

• Training of tabular data, For example, CTR used in recommendation systems
• Training of text data, For example, text classification
• Training of image data, For example, image classification
• Training of LLM, For example, llm pretrain

very easy to use

pip install scarabs

In detail

1. Tabular Data You can refer to tabular_ctr in the examples folder

2. Text Data You can refer to llm_classification in the examples folder

3. LLM You can refer to llm_pretrain in the examples folder

4. refer to github https://github.com/zhu2856061/scarabs

todo

use visdom