isage-finetune 0.1.0.3

SAGE Fine-tuning Framework - Trainers and data loaders for LLM fine-tuning

sage-finetune

Fine-tuning implementations for the SAGE AI data processing framework.

Installation

pip install isage-finetune

For LoRA training:

pip install isage-finetune[peft]

Features

• LoRA Trainer: Parameter-efficient fine-tuning with Low-Rank Adaptation
• Mock Trainer: Testing trainer for pipeline validation
• JSON/JSONL Loader: Flexible data loading for instruction and chat formats

Quick Start

from sage_finetune import MockTrainer, JSONDatasetLoader

# Load training data
loader = JSONDatasetLoader()
train_data = loader.load("train.jsonl")

# Train (mock for testing)
trainer = MockTrainer()
result = trainer.train(train_data)
print(f"Loss: {result['train_loss']:.4f}")

LoRA Fine-tuning

from sage_finetune import LoRATrainer, LoRAConfig

trainer = LoRATrainer(
    model_name="gpt2",
    lora_config=LoRAConfig(r=8, lora_alpha=16),
)

result = trainer.train(train_dataset)
trainer.save_model("./my_lora_model")

Data Formats

Instruction Format

{"instruction": "Summarize this text", "input": "Long text...", "output": "Summary..."}

Chat Format

{"messages": [{"role": "user", "content": "Hello"}, {"role": "assistant", "content": "Hi"}]}

Integration with SAGE

When SAGE is installed, components auto-register with the framework:

from sage.libs.finetune import create_trainer

trainer = create_trainer("lora", model_name="gpt2")

License

Apache 2.0