Skip to main content

A seamless voice dictation system for Linux

Project description

Vocalinux

Voice-to-text for Linux, finally done right!

Status: Beta GitHub release License: GPL v3

Vocalinux CI Platform: Linux Python 3.9+ Made with GTK codecov

GitHub stars GitHub forks GitHub watchers Last commit Commit activity Contributions welcome GitHub issues

Vocalinux Users

Linux has always punched above its weight, except when it comes to voice typing. Vocalinux fixes that.

It's a free, GPLv3-licensed desktop app that lets you dictate text into any application, on X11 or Wayland, using fully offline speech recognition. Pick from three engines (whisper.cpp, OpenAI Whisper, or VOSK), get automatic GPU acceleration via Vulkan, and control it all with customizable keyboard shortcuts: toggle or push-to-talk.

No internet required. No data leaves your machine. Just speak and type.

๐Ÿ“š What's New in v0.14.0-beta

๐ŸŽ‰ Release: Configurable keyboard shortcuts, FunASR/SenseVoice remote-API support, and another round of Wayland reliability fixes.

๐Ÿš€ Highlights

Feature Description
โŒจ๏ธ Configurable Shortcuts Bind any modifier combination to a key โ€” e.g. Alt+R, Ctrl+Shift+V, or Super+F10
๐ŸŒ FunASR / SenseVoice Remote API Remote-API engine now supports FunASR and SenseVoice models via OpenAI-compatible endpoints
๐Ÿ–ฅ๏ธ GNOME Wayland IBus Reliability Text injection works again on GNOME Wayland with bare xkb layouts and engine restore fallbacks are fixed
๐ŸŽ™๏ธ Audio Crash Fix Recording no longer crashes when the system audio device index changes between sessions
โšก Hybrid-CPU Efficiency whisper.cpp no longer defaults to all cores on hybrid Intel/AMD processors

โœจ New Features

  • Configurable modifier+key hotkeys โ€” The Settings dialog now lets you set custom shortcuts using any combination of Ctrl, Alt, Shift, and Super plus a letter/number key. The legacy defaults still work, and you can now bind combinations like Alt+R or Ctrl+Shift+V (#493)
  • Remote API FunASR/SenseVoice support โ€” OpenAI-compatible remote endpoints can specify FunASR/SenseVoice model names (e.g. sensevoice) and return richer response shapes; SenseVoice metadata labels are stripped before text injection (#468)

๐Ÿ› Bug Fixes

  • GNOME Wayland/IBus: Restore text injection when only a bare xkb engine is configured; the engine restore fallback now picks the correct IM engine instead of silently dropping text (#506, #500)
  • KDE Wayland/IBus: Restore the KDE Plasma Wayland IBus text-injection path that was regressed in recent compositor-detection changes (#502)
  • Wayland injection: Wait for held modifiers (Ctrl/Alt/Shift/Super) to release before injecting text, preventing accidental shortcut triggers and garbled output on modifier-heavy workflows (#494)
  • Shortcuts UI: Keep preset and custom shortcut selection exclusive โ€” selecting a preset now clears the custom field, and setting a custom combo selects the "Custom Shortcut" preset (#509)
  • whisper.cpp: Stop defaulting to all CPU cores on hybrid processors (Intel Performance + Efficient cores), which caused UI lag and excess battery drain (#492)
  • Audio: Fix a crash on recording start when the selected audio device index no longer matches the current system enumeration (#499)
  • Installer: Include xsel as a fallback for the Wayland clipboard path when xclip is unavailable (#496)

๐Ÿ”ง Improvements

  • Code style โ€” Removed an outdated long comment about whisper.cpp default thread counts (#505)

โœจ Features

  • ๐ŸŽค Toggle or Push-to-Talk activation modes
  • โšก Real-time transcription with minimal latency
  • ๐ŸŒŽ Universal compatibility across all Linux applications
  • ๐Ÿ”’ 100% Offline operation for privacy and reliability
  • ๐Ÿค– whisper.cpp by default - High-performance C++ speech recognition
  • ๐ŸŽฎ Universal GPU support - Vulkan acceleration for AMD, Intel, and NVIDIA
  • ๐ŸŽจ System tray integration with visual status indicators
  • ๐Ÿš€ Start on login support via XDG autostart (desktop-session startup)
  • ๐Ÿ”Š Pleasant audio feedback - smooth gliding tones, headphone-friendly
  • โš™๏ธ Graphical settings dialog for easy configuration
  • ๐Ÿ“ฆ 3 engine choices - whisper.cpp (default), OpenAI Whisper, or VOSK

๐Ÿ“ธ Screenshots

Here are some screenshots showcasing Vocalinux in action:

Transcription in Action
Real-time voice-to-text transcription
System Tray
System tray with listening indicator
About View
About view with version info
Log Viewer
Log viewer for debugging
Features Overview
Overview of key features and configuration options with annotations

๐Ÿš€ Quick Install

Interactive Install (Recommended)

Our new interactive installer guides you through setup with intelligent hardware detection:

curl -fsSL raw.githubusercontent.com/jatinkrmalik/vocalinux/main/install.sh -o /tmp/vl.sh && bash /tmp/vl.sh

Choose your engine:

  1. whisper.cpp โญ (Recommended) - Fast, works with any GPU via Vulkan
  2. Whisper (OpenAI) - PyTorch-based, NVIDIA GPU only
  3. VOSK - Lightweight, works on older systems

The installer will:

  • Auto-detect your hardware (GPU, RAM, Vulkan support)
  • Recommend the best engine for your system
  • Download the appropriate model (~74MB for the default whisper.cpp tiny model)
  • Install neural VAD support when ONNX Runtime is available
  • Install in ~1-2 minutes (vs 5-10 min with old Whisper)

Note: Always installs the latest release. For a specific version, check GitHub Releases.

Installation Options

Default (whisper.cpp - recommended):

curl -fsSL raw.githubusercontent.com/jatinkrmalik/vocalinux/main/install.sh -o /tmp/vl.sh && bash /tmp/vl.sh

Fastest installation (~1-2 min), universal GPU support via Vulkan.

Whisper (OpenAI) - if you prefer PyTorch:

curl -fsSL raw.githubusercontent.com/jatinkrmalik/vocalinux/main/install.sh -o /tmp/vl.sh && bash /tmp/vl.sh --engine=whisper

NVIDIA GPU only (~5-10 min, downloads PyTorch + CUDA).

VOSK only - for low-RAM systems:

curl -fsSL raw.githubusercontent.com/jatinkrmalik/vocalinux/main/install.sh -o /tmp/vl.sh && bash /tmp/vl.sh --engine=vosk

Lightweight option (~40MB), works on systems with 4GB RAM.

Alternative: Install from Source

# Clone the repository
git clone https://github.com/jatinkrmalik/vocalinux.git
cd vocalinux

# Run the installer (will prompt for Whisper)
./install.sh

# Or with Whisper support
./install.sh --with-whisper

The installer handles everything: system dependencies, Python environment, speech models, and desktop integration.

๐ŸŒ™ Nightly Releases (Bleeding Edge)

For developers and early adopters who want to test the latest features, check out our GitHub Releases page which includes both beta and nightly builds.

โš ๏ธ Warning: Nightly releases contain the absolute latest code and may be unstable. For production use, we recommend using the latest beta release.

Nightly builds are automatically generated from the main branch every day. They include all merged changes but haven't undergone the same testing as beta releases.

Release Channels:

  • Beta (Recommended) - Tested pre-releases with known features
  • Nightly - Untested bleeding edge with latest commits

After Installation

# If ~/.local/bin is in your PATH (recommended):
vocalinux

# Or activate the virtual environment first:
source ~/.local/bin/activate-vocalinux.sh
vocalinux

# Or run directly:
~/.local/share/vocalinux/venv/bin/vocalinux

Or launch it from your application menu!

๐Ÿ“‹ Requirements

  • OS: Linux (tested on Ubuntu 22.04+, Debian 11+, Fedora 39+, Arch Linux, openSUSE Tumbleweed)
  • Python: 3.9 or newer
  • Display: X11 or Wayland
  • Hardware: Microphone for voice input

Note: See Distribution Compatibility for distribution-specific information and experimental support for Gentoo, Alpine, Void, Solus, and more.

๐ŸŽ™๏ธ Usage

Voice Dictation

  1. Toggle mode: Double-tap the shortcut key (default Ctrl) to start recording
  2. Speak clearly into your microphone
  3. Toggle mode: Double-tap again (or pause speaking) to stop, or Push-to-Talk mode: release the key to stop

Voice Commands

Command Action
"new line" Inserts a line break
"period" / "full stop" Types a period (.)
"comma" Types a comma (,)
"question mark" Types a question mark (?)
"exclamation mark" Types an exclamation mark (!)
"delete that" Deletes the last sentence
"capitalize" Capitalizes the next word

Command Line Options

vocalinux --help                  # Show all options
vocalinux --debug                 # Enable debug logging
vocalinux --engine whisper_cpp    # Use whisper.cpp engine (default)
vocalinux --engine whisper        # Use OpenAI Whisper engine
vocalinux --engine vosk           # Use VOSK engine
vocalinux --model medium          # Use medium-sized model
vocalinux --model medium.en-q5_0  # Use exact whisper.cpp model variant
vocalinux --model large-v3-turbo  # Use large-v3 Turbo with whisper.cpp
vocalinux --wayland               # Force Wayland mode
vocalinux --start-minimized       # Start without first-run modal prompts

Autostart on Login

Vocalinux uses the Linux desktop standard for autostart:

  • Mechanism: XDG autostart desktop entry (vocalinux.desktop)
  • Path: $XDG_CONFIG_HOME/autostart/ or ~/.config/autostart/ (fallback)
  • Launch mode: Starts as a regular user desktop app in your graphical session
  • Not used: No systemd unit/service is created by Vocalinux for autostart

How to enable/disable:

  • First-run welcome dialog
  • Tray menu: Start on Login
  • Settings dialog: Start on Login

Compatibility notes:

  • Works on mainstream desktop environments (GNOME, KDE, Xfce, Cinnamon, MATE, LXQt)
  • On minimal/custom window-manager sessions, an autostart handler may be required (for example DE-specific startup hooks or tools like dex)

โš™๏ธ Configuration

Configuration is stored in ~/.config/vocalinux/config.json:

{
  "speech_recognition": {
    "engine": "whisper_cpp",
    "model_size": "tiny",
    "vad_sensitivity": 3,
    "silence_timeout": 2.0
  }
}

For whisper.cpp, model_size may be a size such as tiny or an exact ggml model ID such as medium.en-q5_0 or large-v3-turbo. You can also configure this through the graphical Settings dialog, where whisper.cpp models are split into Model Size and Specialization controls.

Neural Voice Activity Detection

Vocalinux ships with a Silero VAD model and uses it automatically when onnxruntime is available. The official installer attempts to install this support automatically. Without it, recording falls back to the simpler amplitude-threshold VAD.

For manual or PyPI installs, enable neural VAD with:

pip install "vocalinux[vad]"

Restart Vocalinux after install. The Recognition tab in Settings shows which backend is active. The same vad_sensitivity (1-5) works for both -- it's mapped to a Silero probability threshold internally (1 = 0.8, 5 = 0.3).

๐Ÿ”ง Development Setup

# Clone and install in dev mode
git clone https://github.com/jatinkrmalik/vocalinux.git
cd vocalinux
./install.sh --dev

# Activate environment
source venv/bin/activate

# Run tests
pytest

# Run from source with debug
python -m vocalinux.main --debug

๐Ÿ“ Project Structure

vocalinux/
โ”œโ”€โ”€ src/vocalinux/                 # Main application code
โ”‚   โ”œโ”€โ”€ speech_recognition/        # Speech recognition engines (VOSK, Whisper, whisper.cpp)
โ”‚   โ”‚   โ””โ”€โ”€ recognition_manager.py # Unified engine interface
โ”‚   โ”œโ”€โ”€ text_injection/            # Text injection (X11/Wayland)
โ”‚   โ”œโ”€โ”€ ui/                        # GTK UI components
โ”‚   โ””โ”€โ”€ utils/                     # Utility functions
โ”‚       โ”œโ”€โ”€ whispercpp_model_info.py   # whisper.cpp model metadata & hardware detection
โ”‚       โ””โ”€โ”€ vosk_model_info.py         # VOSK model metadata
โ”œโ”€โ”€ tests/                         # Test suite
โ”œโ”€โ”€ scripts/                       # Development utilities
โ”‚   โ””โ”€โ”€ generate_sounds.py         # Sound generation script
โ”œโ”€โ”€ resources/                     # Icons and sounds
โ”œโ”€โ”€ docs/                          # Documentation
โ””โ”€โ”€ web/                           # Website source

๐Ÿ“– Documentation

๐Ÿ”Š Sound Customization

Vocalinux uses smooth, pleasant gliding tones for audio feedback:

  • Start: Ascending F4โ†’A4 (0.6s) - positive, uplifting
  • Stop: Descending A4โ†’F4 (0.6s) - resolves completion
  • Error: Lower descending E4โ†’C4 (0.7s) - gentle but noticeable

All sounds use pure sine waves with smoothstep interpolation for buttery smooth pitch transitions - perfect for headphone use!

Regenerate Sounds

To modify or regenerate the notification sounds:

python scripts/generate_sounds.py

This script generates all three sounds using the same smooth glide algorithm. You can edit the frequencies, durations, and amplitudes in the script to customize the sounds to your preference.

๐Ÿ—บ๏ธ Roadmap

  • Custom icon design โœ…
  • Graphical settings dialog โœ…
  • Whisper AI support โœ…
  • Multi-language support (FR, DE, RU) โœ…
  • whisper.cpp integration (default engine) โœ…
  • Vulkan GPU support โœ…
  • In-app update mechanism
  • Application-specific commands
  • Debian/Ubuntu package (.deb)
  • Wayland support via IBus โœ…
  • Voice command customization

๐ŸŒ The Voca Ecosystem

Vocalinux is part of a family of privacy-first, offline voice dictation tools. Same mission, every operating system.

Platform Project Website GitHub Status
๐Ÿง Linux VocaLinux vocalinux.com jatinkrmalik/vocalinux โœ… Beta v0.14.0
๐ŸŽ macOS VocaMac vocamac.com jatinkrmalik/vocamac ๐Ÿš€ Beta
๐ŸชŸ Windows VocaWin vocawin.com jatinkrmalik/vocawin ๐Ÿ“‹ Planned

Each platform uses native technologies for the best possible integration, while sharing the same privacy-first philosophy and offline-only architecture.

๐Ÿค Contributing

We welcome contributions! Whether it's bug reports, feature requests, or code contributions, please check out our Contributing Guide.

Contributors

Thanks to everyone who has contributed to Vocalinux! ๐Ÿ™Œ

Quick Links

โญ Support

If you find Vocalinux useful, please consider:

  • โญ Starring this repository
  • ๐Ÿ› Reporting bugs you encounter
  • ๐Ÿ“– Improving documentation
  • ๐Ÿ”€ Contributing code

๐Ÿ“œ License

This project is licensed under the GNU General Public License v3.0 - see the LICENSE file for details.

Star Chart

Star History Chart


Made with โค๏ธ for the Linux community

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vocalinux-0.14.0b0.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vocalinux-0.14.0b0-py3-none-any.whl (2.4 MB view details)

Uploaded Python 3

File details

Details for the file vocalinux-0.14.0b0.tar.gz.

File metadata

  • Download URL: vocalinux-0.14.0b0.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for vocalinux-0.14.0b0.tar.gz
Algorithm Hash digest
SHA256 249cd2dc1825df333a7e90ce6335c861e7cc4a8d0e593033717aa274fd1b9362
MD5 73bcfe595abe0950f46e47bccb054c0c
BLAKE2b-256 6158c8440f0bff11bc712bfe1a25fcfeb13e3b302831691350fd3add723dc798

See more details on using hashes here.

File details

Details for the file vocalinux-0.14.0b0-py3-none-any.whl.

File metadata

  • Download URL: vocalinux-0.14.0b0-py3-none-any.whl
  • Upload date:
  • Size: 2.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for vocalinux-0.14.0b0-py3-none-any.whl
Algorithm Hash digest
SHA256 7742813d62f2930e19e69f276d3b339f37251d0789aea7b3c63ccafde1728332
MD5 5122e8b6fe146ccd9de58f75e93853a1
BLAKE2b-256 c6bab88207bb546fed153ceef63700092781c3db4523d894a0cde4f2da367ef0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page