onde-cli 0.4.0

Terminal UI for Onde Inference models, apps, and account management.

onde

A terminal app for managing Onde Inference apps and fine-tuning models locally.
Sign in, assign models, and train adapters without bouncing between browser tabs.

---

Install

pip install onde-cli

That installs the native onde binary for your platform. No compiler setup, no Node.js, no extra runtime to babysit. For package docs and the full install matrix, see https://ondeinference.com/cli.

What you get

Run:

onde

and you'll get a full terminal UI where you can:

• sign up or sign in
• create and rename apps
• assign models to apps
• fine-tune supported Qwen models locally
• merge adapters and export GGUF files

If you prefer doing this work in a terminal instead of a browser, that's the whole point.

Keyboard shortcuts

Auth screen

Key	Action
Tab	Move between fields
Enter	Submit
Ctrl+L	Switch to sign in
Ctrl+N	Switch to create account
Ctrl+C	Quit

Apps list

Key	Action
↑ ↓	Move through apps
Enter	Open app details
n	Create a new app
s	Sign out
Ctrl+C	Quit

App detail

Key	Action
m	Assign or change model
r	Rename app
s	Sign out
Esc	Back to apps list

Model picker

Key	Action
↑ ↓	Move through models
Enter	Assign selected model
Esc	Cancel

Fine-tuning

Key	Action
↑ ↓	Move through models
f	Open fine-tune config for the selected model
m	Merge adapter into base model
g	Export merged model to GGUF

Fine-tuning

onde can fine-tune Qwen2, Qwen2.5, and Qwen3 safetensors models with LoRA.

Training runs locally:

• on Metal for Apple Silicon
• on CPU everywhere else

No cloud training job. No Python environment. No notebook setup spiral.

If you want the short version of what happens inside the model at inference time, Onde also has a plain-English note on the forward pass.

Supported base models

Model	Size
Qwen/Qwen3-0.6B	~1.2 GB
Qwen/Qwen2.5-1.5B-Instruct	~3.0 GB
Qwen/Qwen3-1.7B	~3.4 GB
Qwen/Qwen3-4B	~8.0 GB

Only safetensors models can be fine-tuned. GGUF models are already quantized, so this pipeline doesn't use them as training inputs.

Training data format

Use one JSON object per line. Each object needs a text field containing the full conversation in Qwen's chat template.

{"text": "<|im_start|>user\nWhat is the boiling point of water?<|im_end|>\n<|im_start|>assistant\n100°C at sea level.<|im_end|>"}
{"text": "<|im_start|>user\nWhat about at high altitude?<|im_end|>\n<|im_start|>assistant\nLower, around 90°C at 3000 m.<|im_end|>"}

Running a fine-tune

1. Open the Models tab.
2. Pick a safetensors model with ↑ / ↓.
3. Press f.
4. Set your training data path, LoRA rank, epochs, and learning rate.
5. Start training.

Default values:

• LoRA rank: 8
• Epochs: 3
• Learning rate: 0.0001

As a rough reference, a rank-8 adapter for the 0.6B model is about 1.5 MB.

After training

Once the run finishes:

• press m to merge the adapter into the base weights
• press g to export the merged model to GGUF

The exported file loads directly in the Onde SDK for on-device AI inference.

Other ways to install

Method	Command
npm	npm install -g @ondeinference/cli
Homebrew	brew install ondeinference/homebrew-tap/onde
uv	uv tool install onde-cli
Dart pub	dart pub global activate onde_cli
.NET tool	dotnet tool install --global Onde.Cli
Cargo	cargo install onde-cli

Build from source

git clone https://github.com/ondeinference/onde-cli
cd onde-cli
cargo build --release
./target/release/onde

Platform support

Prebuilt native binaries are available for:

Platform	Architecture
macOS	arm64, x64
Linux (glibc)	arm64, x64
Windows	arm64, x64

Debug logs

Logs are written to ~/.cache/onde/debug.log.

The app uses the terminal screen directly while the TUI is open, so logs go to the file instead of printing over the interface.

Related SDKs

SDK	Install
Swift SDK	Swift Package Manager
Flutter SDK	flutter pub add onde_inference
React Native SDK	npm i @ondeinference/react-native
Rust crate	cargo add onde

Source and issues

This package ships a prebuilt native binary. The source code lives here:

github.com/ondeinference/onde-cli

Bug reports and feature requests should go there too.

License

Dual-licensed under MIT and Apache 2.0.

• MIT License
• Apache License 2.0

---

Copyright

© 2026 Splitfire AB (Onde Inference).