ispeak 0.1.0

A keyboard-centric CLI speech-to-text tool that works wherever you can type

ispeak

A keyboard-centric CLI speech-to-text tool that works wherever you can type, be it vim, emacs, firefox, or AI tools like aider and claude.

• Keyboard Output - Transcribed speech is produced as keyboard (press/release) events
• Inline UX - The recording indicator is displayed in the active buffer and then self-deletes
• Hotkey-Driven & Configurable - With various models, delete, and replace commands
• Local & Fast - Powered via faster-whisper with help from RealtimeSTT
• Cross-Platform - Works on Linux/macOS/Windows with GPU or CPU

Quick Start

1. Run: ispeak (add -b <program> to target a specific executable)
2. Activate: Press the hotkey (default end) - the 'recording indicator' is text-based (default ;)
3. Record: Speak freely; no automatic timeout or voice activity cutoff
4. Complete: Press the hotkey again to delete the indicator and transcribe your speech (abort via escape)
5. Output: Your words appear as typed text at your cursor's location

IMPORTANT: The output goes to the application that currently has keyboard focus, which allows you to use the same ispeak instance between applications. This may be a feature or a bug.

▎Install

git clone https://github.com/fetchTe/ispeak
cd ispeak

# Local development install
uv sync                    # with CUDA (default)
uv sync --extra cpu        # CPU-only (no CUDA)
uv sync --extra cu118      # CUDA v11.8
uv sync --extra cu128      # CUDA v12.8

# Global install
uv tool install .          # with CUDA (default)
uv tool install ".[cpu]"   # CPU-only (no CUDA)
uv tool install ".[cu118]" # CUDA v11.8
uv tool install ".[cu128]" # CUDA v12.8

# Manual dependencies (with CUDA)
pip install RealtimeSTT pynput rich

# Manual dependencies (CPU-only)
pip install torch torchaudio --index-url https://download.pytorch.org/whl/cpu
pip install RealtimeSTT pynput rich

uv is a python package installer

▎Usage

# Using the installed command
ispeak --setup         # Interactive configuration wizard
ispeak --config-show   # Display current configuration
ispeak --test          # Test voice input functionality
ispeak --help          # Show help

ispeak                 # Start with config default (none)
ispeak -b vim          # Start with vim
ispeak -b aider        # Start with ai tool like aider/claude
ispeak -l words.log    # Log transcriptions to file
ispeak -n              # Disable typing output, still log/print transcriptions

# Using local helper script
./ispeak --setup

# Using uv (for development)
uv run ispeak --setup
uv run ispeak -b aider

Configuration

{
  "ispeak": {
    "binary": null,
    "push_to_talk_key": "end",
    "push_to_talk_key_delay": 0.2,
    "escape_key": "esc",
    "recording_indicator": ";",
    "log_file": null,
    "no_typing": false,
    "delete_keywords": ["delete", "undo"],
    "strip_whitespace": true
  },
  "realtime_stt": {
    "language": "auto",
    "model": "base",
    "post_speech_silence_duration": 1.0,
    "silero_use_onnx": true,
    "spinner": false
  },
  "replace": null,
}

1. Environment Variable: Set ISPEAK_CONFIG environment variable to specify a custom config file path
2. Platform-Specific Default: <config_dir>/ispeak/ispeak.json
   • macOS: ~/Library/Preferences/ispeak/ispeak.json
   • Windows: %APPDATA%\ispeak\ispeak.json (or ~/AppData/Roaming/ispeak/ispeak.json)
   • Linux: $XDG_CONFIG_HOME/ispeak/ispeak.json (or ~/.config/ispeak/ispeak.json)
3. Local Fallback: ./ispeak.json in the current working directory

▎ ispeak

• binary (str/null): Default executable to launch with voice input
• delete_keywords (list/bool): Words that trigger deletion of previous input via backspace (must be exact match)
• escape_key (str/null): Key to cancel current recording without transcription
• log_file (str/null): Path to file for logging voice transcriptions
• no_typing (bool): Disable typing output and recording indicator (voice-only mode)
• push_to_talk_key_delay (float): Brief delay after hotkey press to prevent input conflicts
• push_to_talk_key (str/null): Hotkey to start/stop recording sessions
• strip_whitespace (bool): Remove extra whitespace from transcribed text
• recording_indicator (str/null): Visual indicator typed when recording starts must be a typeable character

Hotkeys work via pynput and support:
╸ Simple characters: a, b, c, 1, etc.
╸ Special keys: end, alt_l, ctrl_l - (see pynput Key class)
╸ Key combinations: <ctrl>+<alt>+h, <shift>+<space>

▎realtime_stt

Full documentation available in ./RealtimeSTT.md or the RealtimeSTT repository.

• language: (str) Language code (en, es, fr, de, etc) or "auto" for automatic detection
• post_speech_silence_duration: (float) How long to wait after you stop talking (default: 1.0)
• download_root: (str) Where to store downloaded models
• device: (str) Force "cpu" or "cuda" (auto-detected by default)
• spinner: (bool) Set to false to avoid messing with the terminal state
• model: (str) Model size or path to local CTranslate2 model (for english variant append .en)
  • tiny: Uber fast, decent accuracy (~39MB, CPU/GPU)
  • base: Balance of speed/accuracy (~74MB, CPU/GPU ~1GB/VRAM)
  • small: Better accuracy (~244MB, GPU ~2GB/VRAM)
  • medium: Better accuracy (~769MB, GPU ~3GB/VRAM)
  • large-v1/large-v2: Best accuracy (~1550MB, GPU ~4GB/VRAM)

▎ replace

Regex replacement rules - either a dict of pattern/replacement pairs or a list of JSON file paths that contain a dict of pattern/replacement pairs. These rules are simply a set of helpers that are applied to the transcribed text.

{
  "replace": {
    "read me": "README",

    "(\\s+)(semi)(\\s+)": ";\\g<3>",
    "(\\s+)(comma)(\\s+)": ",\\g<3>",

    "\\s*question\\s*mark\\s*": "?",
    "\\s*exclamation\\s*mark\\s*": "!",

    "\\s*open\\s*paren\\s*": "(",
    "\\s*close\\s*paren\\s*": ")",

    "/^start/m": "BEGIN"
  }
}

tests: ./test/test_replace.py

Troubleshooting

• Hotkey/Keyboard Issues: Check/grant permissions see linux, macOS, windows
• Recording Indicator Misfire(s): Increase push_to_talk_key_delay (try 0.2-1.0)
• Transcription Issues: Try the CPU-only installation and/or the following minimal test code to isolate the problem:

# test_audio.py -> uv run ./test_audio.py
from RealtimeSTT import AudioToTextRecorder

def process_text(text):
    print(f"Transcribed: {text}")

if __name__ == '__main__':
    print("Testing RealtimeSTT - speak after you see 'Listening...'")
    try:
        recorder = AudioToTextRecorder()
        while True:
            recorder.text(process_text)
    except KeyboardInterrupt:
        print("\nTest completed.")
    except Exception as e:
        print(f"Error: {e}")

Platform Limitations

These limitations/quirks come from the pynput docs

▎Linux

When running under X, the following must be true:

• An X server must be running
• The environment variable $DISPLAY must be set

When running under uinput, the following must be true:

• You must run your script as root, to that is has the required permissions for uinput

The latter requirement for X means that running pynput over SSH generally will not work. To work around that, make sure to set $DISPLAY:

$ DISPLAY=:0 python -c 'import pynput'

Please note that the value DISPLAY=:0 is just an example. To find the actual value, please launch a terminal application from your desktop environment and issue the command echo $DISPLAY.

When running under Wayland, the X server emulator Xwayland will usually run, providing limited functionality. Notably, you will only receive input events from applications running under this emulator.

▎macOS

Recent versions of macOS restrict monitoring of the keyboard for security reasons. For that reason, one of the following must be true:

• The process must run as root.
• Your application must be white listed under Enable access for assistive devices. Note that this might require that you package your application, since otherwise the entire Python installation must be white listed.
• On versions after Mojave, you may also need to whitelist your terminal application if running your script from a terminal.

All listener classes have the additional attribute IS_TRUSTED, which is True if no permissions are lacking.

▎Windows

Virtual events sent by other processes may not be received. This library takes precautions, however, to dispatch any virtual events generated to all currently running listeners of the current process.

Development

▎Structure

ispeak/
├── src/ispeak/            # Main package source
│   ├── __init__.py            # Package initialization and exports
│   ├── cli.py                 # Command-line interface and interactive setup
│   ├── config.py              # Configuration management and validation
│   ├── core.py                # Core voice input and text processing logic
│   └── recorder.py            # Audio recording abstraction layer
├── main.py                    # Development entry point
├── ispeak                 # Legacy shell helper script
├── ispeak.json            # Local fallback configuration
├── pyproject.toml             # Project metadata and dependencies
└── README.md                  # Documentation

▎Development Commands

# Type checking
uv run pyright                 # Type check all source files

# Code linting and formatting
uv run ruff check .            # Lint code
uv run ruff check . --fix      # Auto-fix linting issues
uv run ruff format .           # Format code

# Run in development mode
uv run ispeak --setup      # Test setup wizard
uv run ispeak --test       # Test voice input

Contributing

1. Fork the repository
2. Create a feature branch: git checkout -b feature/amazing-feature
3. Install development dependencies: uv sync --group dev
4. Make your changes following the existing code style
5. Run quality checks:

   uv run ruff check . --fix    # Fix linting issues
   uv run ruff format .         # Format code
   uv run pyright              # Type checking
   

6. Test your changes: uv run ispeak --test
7. Commit your changes: git commit -m 'feat: add amazing feature'
8. Push to your branch: git push origin feature/amazing-feature
9. Open a Pull Request with a clear description of your changes

Acknowledgments

• RealtimeSTT - A swell wrapper around faster-whisper that powers the speech-to-text engine
• pynput - Cross-platform controller and monitorer for the keyboard
• whisper - The foundational speech-to-text recognition model

License

MIT License

Copyright (c) 2025 te <[e-mail]>

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.