Skip to main content

Terminal UI for Onde Inference models, apps, and account management.

Project description

Onde Inference

onde

A terminal app for managing Onde Inference apps and fine-tuning models locally.
Sign in, assign models, and train adapters without bouncing between browser tabs.

Website PyPI npm pub.dev NuGet Crates.io License


onde CLI app list and model assignments



Install

pip install onde-cli

That installs the native onde binary for your platform. No compiler setup, no Node.js, no extra runtime to babysit. For package docs and the full install matrix, see https://ondeinference.com/cli.

What you get

Run:

onde

and you'll get a full terminal UI where you can:

  • sign up or sign in
  • create and rename apps
  • assign models to apps
  • fine-tune supported Qwen models locally
  • merge adapters and export GGUF files

If you prefer doing this work in a terminal instead of a browser, that's the whole point.

Keyboard shortcuts

Auth screen

Key Action
Tab Move between fields
Enter Submit
Ctrl+L Switch to sign in
Ctrl+N Switch to create account
Ctrl+C Quit

Apps list

Key Action
Move through apps
Enter Open app details
n Create a new app
s Sign out
Ctrl+C Quit

App detail

Key Action
m Assign or change model
r Rename app
s Sign out
Esc Back to apps list

Model picker

Key Action
Move through models
Enter Assign selected model
Esc Cancel

Fine-tuning

Key Action
Move through models
f Open fine-tune config for the selected model
m Merge adapter into base model
g Export merged model to GGUF

Fine-tuning

onde can fine-tune Qwen2, Qwen2.5, and Qwen3 safetensors models with LoRA.

Training runs locally:

  • on Metal for Apple Silicon
  • on CPU everywhere else

No cloud training job. No Python environment. No notebook setup spiral.

If you want the short version of what happens inside the model at inference time, Onde also has a plain-English note on the forward pass.

Supported base models

Model Size
Qwen/Qwen3-0.6B ~1.2 GB
Qwen/Qwen2.5-1.5B-Instruct ~3.0 GB
Qwen/Qwen3-1.7B ~3.4 GB
Qwen/Qwen3-4B ~8.0 GB

Only safetensors models can be fine-tuned. GGUF models are already quantized, so this pipeline doesn't use them as training inputs.

Training data format

Use one JSON object per line. Each object needs a text field containing the full conversation in Qwen's chat template.

{"text": "<|im_start|>user\nWhat is the boiling point of water?<|im_end|>\n<|im_start|>assistant\n100°C at sea level.<|im_end|>"}
{"text": "<|im_start|>user\nWhat about at high altitude?<|im_end|>\n<|im_start|>assistant\nLower, around 90°C at 3000 m.<|im_end|>"}

Running a fine-tune

  1. Open the Models tab.
  2. Pick a safetensors model with / .
  3. Press f.
  4. Set your training data path, LoRA rank, epochs, and learning rate.
  5. Start training.

Default values:

  • LoRA rank: 8
  • Epochs: 3
  • Learning rate: 0.0001

As a rough reference, a rank-8 adapter for the 0.6B model is about 1.5 MB.

After training

Once the run finishes:

  • press m to merge the adapter into the base weights
  • press g to export the merged model to GGUF

The exported file loads directly in the Onde SDK for on-device AI inference.

Other ways to install

Method Command
npm npm install -g @ondeinference/cli
Homebrew brew install ondeinference/homebrew-tap/onde
uv uv tool install onde-cli
Dart pub dart pub global activate onde_cli
.NET tool dotnet tool install --global Onde.Cli
Cargo cargo install onde-cli

Build from source

git clone https://github.com/ondeinference/onde-cli
cd onde-cli
cargo build --release
./target/release/onde

Platform support

Prebuilt native binaries are available for:

Platform Architecture
macOS arm64, x64
Linux (glibc) arm64, x64
Windows arm64, x64

Debug logs

Logs are written to ~/.cache/onde/debug.log.

The app uses the terminal screen directly while the TUI is open, so logs go to the file instead of printing over the interface.

Related SDKs

SDK Install
Swift SDK Swift Package Manager
Flutter SDK flutter pub add onde_inference
React Native SDK npm i @ondeinference/react-native
Rust crate cargo add onde

Source and issues

This package ships a prebuilt native binary. The source code lives here:

github.com/ondeinference/onde-cli

Bug reports and feature requests should go there too.

License

Dual-licensed under MIT and Apache 2.0.


Copyright

© 2026 Splitfire AB (Onde Inference).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onde_cli-0.4.1.tar.gz (936.5 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onde_cli-0.4.1-py3-none-win_arm64.whl (21.7 MB view details)

Uploaded Python 3Windows ARM64

onde_cli-0.4.1-py3-none-win_amd64.whl (23.3 MB view details)

Uploaded Python 3Windows x86-64

onde_cli-0.4.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.5 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

onde_cli-0.4.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (21.8 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

onde_cli-0.4.1-py3-none-macosx_11_0_arm64.whl (38.9 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

onde_cli-0.4.1-py3-none-macosx_10_12_x86_64.whl (40.0 MB view details)

Uploaded Python 3macOS 10.12+ x86-64

File details

Details for the file onde_cli-0.4.1.tar.gz.

File metadata

  • Download URL: onde_cli-0.4.1.tar.gz
  • Upload date:
  • Size: 936.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for onde_cli-0.4.1.tar.gz
Algorithm Hash digest
SHA256 bad60e4ff148b95b4570298a4c8a3e8b38b506003e2a1d3240d6870db126fc3d
MD5 61a3d9c47cf57e09c6b1a5aaefcfefa8
BLAKE2b-256 ee6dd9e24bc302f52b67adbf82d1c1799f3325874c884f8b17647156ff9df5bc

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1.tar.gz:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-win_arm64.whl.

File metadata

  • Download URL: onde_cli-0.4.1-py3-none-win_arm64.whl
  • Upload date:
  • Size: 21.7 MB
  • Tags: Python 3, Windows ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for onde_cli-0.4.1-py3-none-win_arm64.whl
Algorithm Hash digest
SHA256 6e364e8c9c1482a12b933bc896b82a7341a841b489de2614b5d59c62baff66f0
MD5 1342274bc92ebed93e545f26d2e37474
BLAKE2b-256 adb497be533891823d0f4c910b37d5d6a7c878be79760dc2ad16844ab0c4bc18

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-win_arm64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-win_amd64.whl.

File metadata

  • Download URL: onde_cli-0.4.1-py3-none-win_amd64.whl
  • Upload date:
  • Size: 23.3 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for onde_cli-0.4.1-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 d92116376715e2029a689c12936a0435446c40ac16dc516910e9aa4a495b9c42
MD5 41034c1a0afd36c0d9999520af3f78d3
BLAKE2b-256 6a5e381d03f65994caee5bfd263539ae0930a08ad51b038de2387d6bddb15ad7

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-win_amd64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onde_cli-0.4.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 8059ec24be502eb08f9bc34514f8b46a7c8cb4a25150872655092303bc56b7c7
MD5 f1cb44932c957cbc496758f2909af4ab
BLAKE2b-256 b8d5a37ae4c19d431675d246185d28265a2105fee4196810a86d9d3875d42930

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for onde_cli-0.4.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 205c564a82ef2c7dde294730562c6f8ca8cfe8a6087c93e4500872fdc0c11d53
MD5 bb17881d7b1b98cb8ceb2ed4e76861a1
BLAKE2b-256 da77e6f19064512557f430352d42e05fc57cb415af7739f46ec41fb164f39ba1

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for onde_cli-0.4.1-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 619f4e51100fd61425ea2c720265750d57cfbe937c23e9a007b463a1e49ee256
MD5 9ed0326ec34d52d1c5351929e837c9c7
BLAKE2b-256 db1ee12fcfcdc7679ae7b15b54b9a664b3cb9ace4ed0b0c3c1c1f791a3253431

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-macosx_11_0_arm64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.4.1-py3-none-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for onde_cli-0.4.1-py3-none-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 08ae6672b576b67fe83176e95856871a370ff5eb5740644fc4f7f9c27c2018d6
MD5 a57c159c482fddfc4fe69c47830cda08
BLAKE2b-256 49f0c79c9bd6f8d7bd69f362e3a6d46f469d378ad6ad67709b0dcdc68f119a93

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.4.1-py3-none-macosx_10_12_x86_64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page