Skip to main content

Terminal UI for Onde Inference models, apps, and account management.

Project description

Onde Inference

onde

A terminal app for managing Onde Inference apps and fine-tuning models locally.
Sign in, assign models, and train adapters without bouncing between browser tabs.

Website PyPI npm pub.dev NuGet Crates.io License


onde CLI app list and model assignments



Install

pip install onde-cli

That installs the native onde binary for your platform. No compiler setup, no Node.js, no extra runtime to babysit. For package docs and the full install matrix, see https://ondeinference.com/cli.

What you get

Run:

onde

and you'll get a full terminal UI where you can:

  • sign up or sign in
  • create and rename apps
  • assign models to apps
  • fine-tune supported Qwen models locally
  • merge adapters and export GGUF files

If you prefer doing this work in a terminal instead of a browser, that's the whole point.

Keyboard shortcuts

Auth screen

Key Action
Tab Move between fields
Enter Submit
Ctrl+L Switch to sign in
Ctrl+N Switch to create account
Ctrl+C Quit

Apps list

Key Action
Move through apps
Enter Open app details
n Create a new app
s Sign out
Ctrl+C Quit

App detail

Key Action
m Assign or change model
r Rename app
s Sign out
Esc Back to apps list

Model picker

Key Action
Move through models
Enter Assign selected model
Esc Cancel

Fine-tuning

Key Action
Move through models
f Open fine-tune config for the selected model
m Merge adapter into base model
g Export merged model to GGUF

Fine-tuning

onde can fine-tune Qwen2, Qwen2.5, and Qwen3 safetensors models with LoRA.

Training runs locally:

  • on Metal for Apple Silicon
  • on CPU everywhere else

No cloud training job. No Python environment. No notebook setup spiral.

If you want the short version of what happens inside the model at inference time, Onde also has a plain-English note on the forward pass.

Supported base models

Model Size
Qwen/Qwen3-0.6B ~1.2 GB
Qwen/Qwen2.5-1.5B-Instruct ~3.0 GB
Qwen/Qwen3-1.7B ~3.4 GB
Qwen/Qwen3-4B ~8.0 GB

Only safetensors models can be fine-tuned. GGUF models are already quantized, so this pipeline doesn't use them as training inputs.

Training data format

Use one JSON object per line. Each object needs a text field containing the full conversation in Qwen's chat template.

{"text": "<|im_start|>user\nWhat is the boiling point of water?<|im_end|>\n<|im_start|>assistant\n100°C at sea level.<|im_end|>"}
{"text": "<|im_start|>user\nWhat about at high altitude?<|im_end|>\n<|im_start|>assistant\nLower, around 90°C at 3000 m.<|im_end|>"}

Running a fine-tune

  1. Open the Models tab.
  2. Pick a safetensors model with / .
  3. Press f.
  4. Set your training data path, LoRA rank, epochs, and learning rate.
  5. Start training.

Default values:

  • LoRA rank: 8
  • Epochs: 3
  • Learning rate: 0.0001

As a rough reference, a rank-8 adapter for the 0.6B model is about 1.5 MB.

After training

Once the run finishes:

  • press m to merge the adapter into the base weights
  • press g to export the merged model to GGUF

The exported file loads directly in the Onde SDK for on-device AI inference.

Other ways to install

Method Command
npm npm install -g @ondeinference/cli
Homebrew brew install ondeinference/homebrew-tap/onde
uv uv tool install onde-cli
Dart pub dart pub global activate onde_cli
.NET tool dotnet tool install --global Onde.Cli
Cargo cargo install onde-cli

Build from source

git clone https://github.com/ondeinference/onde-cli
cd onde-cli
cargo build --release
./target/release/onde

Platform support

Prebuilt native binaries are available for:

Platform Architecture
macOS arm64, x64
Linux (glibc) arm64, x64
Windows arm64, x64

Debug logs

Logs are written to ~/.cache/onde/debug.log.

The app uses the terminal screen directly while the TUI is open, so logs go to the file instead of printing over the interface.

Related SDKs

SDK Install
Swift SDK Swift Package Manager
Flutter SDK flutter pub add onde_inference
React Native SDK npm i @ondeinference/react-native
Rust crate cargo add onde

Source and issues

This package ships a prebuilt native binary. The source code lives here:

github.com/ondeinference/onde-cli

Bug reports and feature requests should go there too.

License

Dual-licensed under MIT and Apache 2.0.


Copyright

© 2026 Onde Inference (Splitfire AB).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onde_cli-0.3.1.tar.gz (901.6 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onde_cli-0.3.1-py3-none-win_arm64.whl (18.8 MB view details)

Uploaded Python 3Windows ARM64

onde_cli-0.3.1-py3-none-win_amd64.whl (19.8 MB view details)

Uploaded Python 3Windows x86-64

onde_cli-0.3.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20.5 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

onde_cli-0.3.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (19.2 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

onde_cli-0.3.1-py3-none-macosx_11_0_arm64.whl (28.2 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

onde_cli-0.3.1-py3-none-macosx_10_12_x86_64.whl (29.0 MB view details)

Uploaded Python 3macOS 10.12+ x86-64

File details

Details for the file onde_cli-0.3.1.tar.gz.

File metadata

  • Download URL: onde_cli-0.3.1.tar.gz
  • Upload date:
  • Size: 901.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onde_cli-0.3.1.tar.gz
Algorithm Hash digest
SHA256 0d7d1b31db679aeab9ff083524bb57d915b520d6a8c48889e990d05340532cc0
MD5 bc03fcaa74c3d08035dbfb18608d1358
BLAKE2b-256 3ddafd0eb3c8a6caccba42e6427e05f00d228cc1f840cb64b67369c79dff4ac5

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1.tar.gz:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-win_arm64.whl.

File metadata

  • Download URL: onde_cli-0.3.1-py3-none-win_arm64.whl
  • Upload date:
  • Size: 18.8 MB
  • Tags: Python 3, Windows ARM64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onde_cli-0.3.1-py3-none-win_arm64.whl
Algorithm Hash digest
SHA256 5bd3a09a04aa2e7540936fca79da8333be10d79c67ddd490f2fa782f17e18e24
MD5 c575634f3de73bad4aaa87b102d3aa17
BLAKE2b-256 ed9e0f204e13b7ff220475e58f6546cc6124733905bfc31b33b37450ea72969d

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-win_arm64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-win_amd64.whl.

File metadata

  • Download URL: onde_cli-0.3.1-py3-none-win_amd64.whl
  • Upload date:
  • Size: 19.8 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onde_cli-0.3.1-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 2e5fca799246d0eb7136533510b8a9a719285cbe3413002cd441e7bd2702c398
MD5 d662832924187bf0b9302fa2f33e6bdd
BLAKE2b-256 75dd2ed8d3d383db4ce96da0d7e24b3fafa5a679c7ee6986b622d2298b50e661

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-win_amd64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for onde_cli-0.3.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 8e180d4c4b6d4bb24e186bdaebdb56a07521f7c5bbf6f035f7256a1161c8ff04
MD5 91cd1914f53879714fc8c02bc5fd8bbd
BLAKE2b-256 cbde356bf6898955be290da1bffd1aff0af7406797d22c216271cf08f0350b71

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for onde_cli-0.3.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 af73bac974ac5d2e56e663176ec8a9461a555f10dcdf47a0205b018d4ed505d7
MD5 bb74dbecf05c9ba918a0a942cd508931
BLAKE2b-256 d4d59ea856c4df34c5754534fee62d04d67bf13dbdf52a199c17092744a3cc63

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for onde_cli-0.3.1-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 fde9f503d544c76a8fc6cfffd285f64697443b2bb4641eb76e0dd7ac71355174
MD5 7c3415ffbac8971177e06e8000568ca2
BLAKE2b-256 67623dfcc1dcd50997d96043028ebc7ce1118d36cfd99e189362ae1a7c645334

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-macosx_11_0_arm64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onde_cli-0.3.1-py3-none-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for onde_cli-0.3.1-py3-none-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 da4989a64eb6c9f317ab1d014ab5b4a31ccccf29b76e464c3585ccc1d0527de6
MD5 982fa2b95bd31425004510902f31cd93
BLAKE2b-256 f57de3b0f18fbfd7def8782e0200216d8b427a44912f8da869496e7dfb6b5c27

See more details on using hashes here.

Provenance

The following attestation bundles were made for onde_cli-0.3.1-py3-none-macosx_10_12_x86_64.whl:

Publisher: release-pypi.yml on ondeinference/onde-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page