sherpa-onnx 2.0.0

Supported functions

Supported platforms

Supported programming languages

It also supports WebAssembly.

Supported frameworks

Flutter

• Pre-built Flutter demo apps: flutter releases

Tauri

• Pre-built Tauri demo apps: tauri releases

Supported NPUs

Join our discord

Introduction

This repository supports running the following functions locally

• Speech-to-text (i.e., ASR); both streaming and non-streaming are supported
• Text-to-speech (i.e., TTS)
• Speaker diarization
• Speaker identification
• Speaker verification
• Spoken language identification
• Audio tagging
• VAD (e.g., silero-vad)
• Speech enhancement (e.g., gtcrn, DPDFNet)
• Keyword spotting
• Source separation (e.g., spleeter, UVR)

on the following platforms and operating systems:

• x86, x86_64, 32-bit ARM, 64-bit ARM (arm64, aarch64), RISC-V (riscv64), RK NPU, Ascend NPU
• Linux, macOS, Windows, openKylin
• Android, WearOS
• iOS
• HarmonyOS
• NodeJS
• WebAssembly
• NVIDIA Jetson Orin NX (Support running on both CPU and GPU)
• NVIDIA Jetson Nano B01 (Support running on both CPU and GPU)
• Raspberry Pi
• RV1126
• LicheePi4A
• VisionFive 2
• 旭日X3派
• 爱芯派
• RK3588
• SpacemiT-K1
• SpacemiT-K3
• etc

with the following APIs

• C++, C, Python, Go, C#
• Java, Kotlin, JavaScript
• Swift, Rust
• Dart, Object Pascal

Links for Huggingface Spaces

Links for pre-built Android APKs

Links for pre-built Flutter APPs

Links for pre-built Lazarus APPs

Links for pre-trained models

Some pre-trained ASR models (Streaming)

Some pre-trained ASR models (Non-Streaming)

Useful links

• Documentation: https://k2-fsa.github.io/sherpa/onnx/
• Bilibili 演示视频: https://search.bilibili.com/all?keyword=%E6%96%B0%E4%B8%80%E4%BB%A3Kaldi

How to reach us

Please see https://k2-fsa.github.io/sherpa/social-groups.html for 新一代 Kaldi 微信交流群 and QQ 交流群.

Projects using sherpa-onnx

VocaRead

iOS app for reading EPUBs, PDFs, and documents aloud. It uses sherpa-onnx to synthesize speech locally with Piper voices and can import books from OPDS catalogs.

Sherpa Voice / @siteed/sherpa-onnx.rn

React Native wrapper and demo app for validating sherpa-onnx on iOS, Android, and Web, including ASR, TTS, VAD, KWS, speaker ID, diarization, language ID, punctuation, audio tagging, and speech enhancement.

• NPM package
• Live demo

SmartVoice

SmartVoice is a local speech application for speech recognition and text-to-speech. Its smartvoice-auto virtual model matches each request's task and language against an editable routing table, then dynamically routes it to the most suitable installed model. sherpa-onnx powers CPU inference; a web interface and HTTP API are included.

Speed of Sound

A voice-typing application for the Linux desktop (GTK4/Adwaita). It captures microphone audio, transcribes it offline using Sherpa ONNX ASR models, optionally polishes the text with an LLM, and types the result into the active window via XDG Remote Desktop Portal keyboard simulation.

VoxSherpa TTS

VoxSherpa TTS is a 100% offline Android Text-to-Speech app powered by Sherpa-ONNX. It supports Kokoro-82M, Piper, and VITS engines with multilingual support including Hindi, English, British English, Japanese, Chinese and 50+ more languages.

• Download APK (All Versions)
• Android 11+ · 100% offline · No telemetry

Generate	Models	Library	Settings

BreezeApp from MediaTek Research

BreezeAPP is a mobile AI application developed for both Android and iOS platforms. Users can download it directly from the App Store and enjoy a variety of features offline, including speech-to-text, text-to-speech, text-based chatbot interactions, and image question-answering

• Download APK for BreezeAPP
• APK 中国镜像

1	2	3

Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

See also https://github.com/t41372/Open-LLM-VTuber/pull/50

voiceapi

腾讯会议摸鱼工具 TMSpeech

Uses streaming ASR in C# with graphical user interface.

Video demo in Chinese: 【开源】Windows实时字幕软件（网课/开会必备）

lol互动助手

It uses the JavaScript API of sherpa-onnx along with Electron

Video demo in Chinese: 爆了！炫神教你开打字挂！真正影响胜率的英雄联盟工具！英雄联盟的最后一块拼图！和游戏中的每个人无障碍沟通！

Sherpa-ONNX 语音识别服务器

A server based on nodejs providing Restful API for speech recognition.

QSmartAssistant

一个模块化，全过程可离线，低占用率的对话机器人/智能音箱

It uses QT. Both ASR and TTS are used.

Flutter-EasySpeechRecognition

It extends ./flutter-examples/streaming_asr by downloading models inside the app to reduce the size of the app.

Note: [Team B] Sherpa AI backend also uses sherpa-onnx in a Flutter APP.

sherpa-onnx-unity

sherpa-onnx in Unity. See also #1695, #1892, and #1859

xiaozhi-esp32-server

本项目为xiaozhi-esp32提供后端服务，帮助您快速搭建ESP32设备控制服务器 Backend service for xiaozhi-esp32, helps you quickly build an ESP32 device control server.

See also

• ASR新增轻量级sherpa-onnx-asr
• feat: ASR增加sherpa-onnx模型

KaithemAutomation

Pure Python, GUI-focused home automation/consumer grade SCADA.

It uses TTS from sherpa-onnx. See also ✨ Speak command that uses the new globally configured TTS model.

Open-XiaoAI KWS

Enable custom wake word for XiaoAi Speakers. 让小爱音箱支持自定义唤醒词。

Video demo in Chinese: 小爱同学启动～˶╹ꇴ╹˶！

C++ WebSocket ASR Server

It provides a WebSocket server based on C++ for ASR using sherpa-onnx.

Go WebSocket Server

It provides a WebSocket server based on the Go programming language for sherpa-onnx.

Making robot Paimon, Ep10 "The AI Part 1"

It is a YouTube video, showing how the author tried to use AI so he can have a conversation with Paimon.

It uses sherpa-onnx for speech-to-text and text-to-speech.

1

TtsReader - Desktop application

A desktop text-to-speech application built using Kotlin Multiplatform.

MentraOS

Smart glasses OS, with dozens of built-in apps. Users get AI assistant, notifications, translation, screen mirror, captions, and more. Devs get to write 1 app that runs on any pair of smart glasses.

It uses sherpa-onnx for real-time speech recognition on iOS and Android devices. See also https://github.com/Mentra-Community/MentraOS/pull/861

It uses Swift for iOS and Java for Android.

flet_sherpa_onnx

Flet ASR/STT component based on sherpa-onnx. Example a chat box agent

achatbot-go

a multimodal chatbot based on go with sherpa-onnx's speech lib api.

fcitx5-vinput

Local offline voice input plugin for Fcitx5 (Linux input method framework). It uses C++ with offline ASR for speech recognition, supporting push-to-talk, command mode, and optional LLM post-processing.

Video demo in Chinese: fcitx5-vinput

Wake Word

A VS Code extension for hands-free voice-activated coding. It uses sherpa-onnx for real-time keyword spotting (KWS) to detect custom wake phrases and trigger VS Code commands by voice. Audio capture is handled by decibri, a cross-platform Node.js microphone streaming library with prebuilt native binaries.

• VS Code Marketplace
• Open VSX
• decibri integration guides for sherpa-onnx

SmartSub

SmartSub is a local-first cross-platform desktop application for the complete subtitle production pipeline: audio/video transcription, subtitle translation, proofreading, and subtitle burning/muxing.

It natively integrates sherpa-onnx to power three offline ASR engines — FunASR, Qwen3-ASR, and FireRedASR — delivering high-accuracy Chinese and multilingual speech recognition entirely on-device, with no file uploads required.

Fono

Talk to your computer. Fono is an open-source (GPL-3.0), complete voice-AI stack (speech-to-text, text-to-speech, a local LLM, wake word, speaker ID) in one small binary for the Linux, macOS, and Windows desktop. Press a key and speak: it types into any app, answers as a voice assistant, or drives a coding agent.

It uses sherpa-onnx's Supertonic TTS models for text-to-speech, with the Supertonic text frontend ported to Rust. See also #3750, which fixes dropped diacritics in the Supertonic frontend for Romanian, Czech, Polish, Hungarian, Turkish, Vietnamese, and other non-English Latin-script languages.

Domia

Domia is an open-source local AI companion you talk to, living entirely on hardware you own. Each Domia is its own character, with a distinct personality, voice, emotional state, and memory of you and its place — and it acts, not just talks: skills connect it to the real world over MCP, Home Assistant included. Domia nodes form a local peer-to-peer mesh that shares speech and reasoning compute, while room satellites bring each companion into the spaces where you live without giving up its identity. No cloud, no accounts, and no data leaving your network.

Domia runs sherpa-onnx in-process for keyword spotting, voice activity detection, streaming and offline speech recognition, and text-to-speech. Speech engines and models are selected through per-companion configuration, making it easy to match supported sherpa-onnx models to different hardware.

qwen-audio-agent

A realtime full-duplex voice runtime for AI coding agents (Claude Code, Codex, OpenCode, and other ACP agents). It uses sherpa-onnx keyword spotting with the 3M-parameter zh-en transducer model to implement a local voice wake word: the app sleeps on idle but keeps the microphone open, and the wake phrase brings the session back with no cloud calls.

Suflyor

An Android teleprompter that scrolls the script as you read it aloud. It runs two streaming Zipformer models on the phone (Russian small-ru-vosk int8 and English en-2023-06-26) and boosts the words of the script as hotwords with modified beam search. A floating window shows the text over the camera app while it records video.

• Download APK
• Website
• Android 10+ · no internet permission · GPL-3.0

Loud Caption

An open-source Flutter app for Android that turns nearby speech into large, high-contrast captions for people with hearing loss. SenseVoice ASR and Silero VAD run fully on-device through sherpa-onnx's Dart API; translation is optional and also local. No account, analytics, or cloud audio.

• Download APK
• Android 8.0+ · arm64-v8a · MIT (app code)

Recly

An open-source recorder for Galaxy Watch, Android, Apple Watch, iPhone, macOS, and Windows. Recordings go to the user's own Google Drive; there is no Recly server. The Android phone app (which also transcribes Galaxy Watch recordings) and the Windows app use sherpa-onnx for on-device transcription: Silero VAD splits each recording into speech segments, and sherpa-onnx's INT8 export of Qwen3-ASR 0.6B transcribes them. The ~1 GB model is downloaded on demand.

China Unicom 中国联通安卓 App

The Android App (version >= 12.14.1 (2026.07.28)) uses sherpa-onnx Kotlin API for keyword spotting.

China Life 中国人寿 App

The Android App (version >= 3.5.46 (2026.03.23)) uses sherpa-onnx Kotlin API for keyword spotting.

deepseek-harness

It uses the JavaScript npm package sherpa-onnx-node with SenseVoice for local speech recognition.

akou

An open-source (GPL-3.0-or-later) call and meeting recorder for macOS that transcribes on the machine. It records the microphone and the call audio on two channels, shows a live transcript, and lets a terminal agent such as Claude Code or Codex follow and question the call over MCP. The same core runs as a self-hosted transcription server in Docker.

It runs sherpa-onnx-node in a Bun Worker: silero-vad splits each channel into speech segments, Parakeet TDT 0.6B v3 (OfflineRecognizer) or streaming Nemotron (OnlineRecognizer) writes the live transcript, and TitaNet embeddings (SpeakerEmbeddingExtractor) help tell the speakers on the call apart. After the call, Parakeet is the fast engine of the final pass and one of the engines of the fused pass. The larger Qwen3-ASR model runs outside sherpa-onnx, on llama-server.

bot-reborn

A $4 toy robot driven by an old Android phone, all from one web page in Chrome. sherpa-onnx runs in the page as WebAssembly: Silero VAD decides when someone is actually talking, so only real speech is sent to STT, and an optional keyword spotter (sherpa-onnx-kws-zipformer-zh-en-3M-2025-12-20) handles the wake word. Both run from one combined build, with the VAD symbols exported from the KWS WebAssembly target.

• Build write-up
• Live page (Chrome on Android)

Voltip

An open-source (AGPL-3.0) push-to-talk dictation app for Windows, macOS, Linux and Android: hold a hotkey, speak, and the text is inserted at the cursor in the focused app. The desktop app uses the sherpa-onnx Rust crate for on-device recognition with SenseVoice and Paraformer, a streaming Zipformer for the live preview while the user speaks, and Silero VAD to trim silence and to split recordings of up to two hours at pauses. Models are downloaded on demand.

• Website
• Releases