hcgf 0.0.2

Humanable ChatGPT/GLM Fine-tuning.

使用

准备数据

每一行一个json，必须包含prompt和completion两个字段。示例如下：

{"prompt": "问题：你是谁？\n", "completion": "不告诉你。"},

正常微调

# 微调
from hchg.sft import GlmLora
data_path = "/path/to/json_data/"
model_id = "THUDM/chatglm-6b"
device = "cuda:0"
model = GlmLora(model_id, device=device)
model.load_data(data_path).tune(device)

# 推理
from hchg.sft import GlmLora
model_id = "THUDM/chatglm-6b"
device = "cuda:0"
model = GlmLora(model_id, device=device)
model.load_pretrained("/path/to/lora_pt").eval()
inp = "你是谁？"
model.chat(inp)