mlx-forge 0.2.7

Fine-tune, experiment with, and run LLMs locally on your Mac

MLX Forge

Fine-tune LLMs on your Mac with MLX. No cloud, no CUDA required.

MLX Forge is a complete LLM fine-tuning toolkit that runs entirely on your Mac. Pick a model, upload your data, and start training — all from a browser-based UI. Supports LoRA, QLoRA, DPO, 18+ models, and 20+ curated datasets out of the box.

pip install mlx-forge
mlx-forge studio

Why MLX Forge?

• One command to start — pip install mlx-forge && mlx-forge studio.
• Browser-based Studio UI — Guided training wizard, real-time loss charts, model library with memory estimates, interactive playground.
• Runs on Apple Silicon — Built on MLX. Your data stays on your machine.
• Production training features — QLoRA (67% memory reduction), sequence packing (2-5x speedup), gradient checkpointing, DPO alignment, compiled training loop.

Quick Start

Studio UI (recommended)

mlx-forge studio
# Opens at http://127.0.0.1:8741

Pick a recipe, choose a model, upload your data, and start training — all from the browser.

CLI

# Browse and download a dataset
mlx-forge data catalog
mlx-forge data download alpaca-cleaned --max-samples 5000

# Train
mlx-forge train --config train.yaml

Models are downloaded from Hugging Face on first run and cached locally. All subsequent runs work offline.

Studio UI

• New Training — Guided wizard: pick a recipe (chat, instruction, DPO, writing style), choose a model, configure, and launch
• Model Library — Browse 18+ models with memory estimates for your hardware
• Experiments — Compare runs, view loss curves in real time
• Datasets — Manage your training data
• Playground — Chat with your fine-tuned models interactively

Supported Models

18 curated models in the Studio library, all tested on Apple Silicon:

Architecture	Models	Sizes
Qwen	Qwen 2.5, Qwen 3, Qwen 3.5	0.5B - 8B
Gemma	Gemma 2, Gemma 3	1B - 9B
Llama	Llama 3.1	8B
Phi	Phi-3 Mini, Phi-4 Mini	3.8B
DeepSeek	DeepSeek-R1-Distill (Qwen-based)	1.5B - 7B
Mistral	Mistral (uses Llama architecture)	7B

Any HF model using a supported architecture will work — the table above shows the curated models with pre-computed memory estimates in Studio.

Features

Training

• LoRA and QLoRA (4-bit) fine-tuning with 67% memory reduction
• DPO (Direct Preference Optimization) for alignment
• Sequence packing for 2-5x speedup on short sequences
• Gradient checkpointing for 40-60% memory savings
• Compiled training loop with gradient accumulation
• Cosine, linear, step, and exponential LR schedules with warmup
• Resume from any checkpoint

Data

• 20+ curated datasets across 7 categories (general, code, math, conversation, reasoning, safety, domain)
• Auto-detection of chat, completions, text, and preference formats
• Multi-dataset mixing with weighted sampling
• Data validation with train/val overlap detection

CLI Reference

Command	Description
mlx-forge studio	Launch the Studio UI
mlx-forge train --config FILE	Run LoRA/QLoRA/DPO training
mlx-forge generate --model MODEL	Generate text or interactive chat
mlx-forge prepare --data FILE --model MODEL	Pre-tokenize a dataset
mlx-forge data catalog	Browse 20+ curated datasets
mlx-forge data download DATASET	Download a dataset from the catalog
mlx-forge data import FILE --name NAME	Import a local JSONL file
mlx-forge data validate FILE	Validate JSONL data
mlx-forge data inspect NAME	Preview dataset samples
mlx-forge data stats NAME	Show dataset statistics

Configuration

schema_version: 1

model:
  path: "Qwen/Qwen3-0.6B"         # HF model ID or local path
  quantization:                     # Optional: QLoRA (67% memory savings)
    bits: 4
    group_size: 64

adapter:
  preset: "attention-qv"           # attention-qv | attention-all | mlp | all-linear
  rank: 16
  scale: 32.0

data:
  train: "./train.jsonl"
  valid: "./val.jsonl"
  packing: false                    # Sequence packing (2-5x speedup)
  max_seq_length: 2048

training:
  optimizer: adamw                  # adam | adamw | sgd | adafactor
  learning_rate: 1.0e-5
  num_iters: 1000
  batch_size: 4
  gradient_checkpointing: false     # 40-60% memory savings
  # training_type: dpo              # For DPO training
  # dpo_beta: 0.1

runtime:
  seed: 42

Data Formats

MLX Forge auto-detects four JSONL formats:

Chat — Multi-turn conversations (loss on assistant turns only):

{"messages": [{"role": "user", "content": "Hello"}, {"role": "assistant", "content": "Hi!"}]}

Completions — Prompt-completion pairs:

{"prompt": "Translate to French: Hello", "completion": "Bonjour"}

Text — Raw text for continued pretraining:

{"text": "The quick brown fox jumps over the lazy dog."}

Preference — For DPO alignment training:

{"chosen": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "good"}], "rejected": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "bad"}]}

Library API

All CLI commands are backed by Python functions:

from mlx_forge import prepare, train
from mlx_forge.config import TrainingConfig

# Train from a config file
config = TrainingConfig.from_yaml("train.yaml")
result = train(config=config)
print(f"Best val loss: {result.best_val_loss:.4f}")

from mlx_forge import generate

# Generate text with a fine-tuned adapter
generate(
    model="Qwen/Qwen3-0.6B",
    adapter="~/.mlxforge/runs/my-run/checkpoints/best",
    prompt="Explain quantum computing in simple terms.",
)

Contributing

See CONTRIBUTING.md for development setup, coding standards, and how to submit changes.

License

MIT