Skip to main content

Wyoming Server for MLX whisper

Project description

Wyoming MLX Whisper

Wyoming protocol server for mlx-whisper speech-to-text on Apple Silicon.

Uses mlx-community/whisper-large-v3-turbo by default, which runs near real-time on M1 Pro and newer.

[ToC] ๐Ÿ“š

Requirements

  • macOS with Apple Silicon (M1/M2/M3)
  • Python 3.10-3.13
  • uv (recommended) or pip

Installation

Using uv (recommended)

git clone https://github.com/basnijholt/wyoming-mlx-whisper.git
cd wyoming-mlx-whisper
uv sync

Using pip

git clone https://github.com/basnijholt/wyoming-mlx-whisper.git
cd wyoming-mlx-whisper
pip install .

Usage

Run directly

# With uv
uv run wyoming-mlx-whisper --uri tcp://0.0.0.0:7891

# Or if installed with pip
wyoming-mlx-whisper --uri tcp://0.0.0.0:7891

Run as macOS service (launchd)

Install the service (starts automatically on login):

./scripts/install_service.sh

The server runs at tcp://localhost:7891 by default.

Uninstall the service:

./scripts/uninstall_service.sh

View logs:

tail -f log/run.out log/run.err

Options

See the output of wyoming-mlx-whisper --help

 Usage: wyoming-mlx-whisper [OPTIONS]

 Run the Wyoming MLX Whisper server.

โ•ญโ”€ Options โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ
โ”‚ --uri                           TEXT  unix:// or tcp://                      โ”‚
โ”‚                                       [env var: WHISPER_URI]                 โ”‚
โ”‚                                       [default: tcp://0.0.0.0:10300]         โ”‚
โ”‚ --model                         TEXT  Name of MLX Whisper model to use       โ”‚
โ”‚                                       [env var: WHISPER_MODEL]               โ”‚
โ”‚                                       [default:                              โ”‚
โ”‚                                       mlx-community/whisper-large-v3-turbo]  โ”‚
โ”‚ --language                      TEXT  Language code (e.g., 'en')             โ”‚
โ”‚                                       [env var: WHISPER_LANGUAGE]            โ”‚
โ”‚ --debug           --no-debug          Log DEBUG messages                     โ”‚
โ”‚                                       [env var: WHISPER_DEBUG]               โ”‚
โ”‚                                       [default: no-debug]                    โ”‚
โ”‚ --log-format                    TEXT  Format for log messages                โ”‚
โ”‚                                       [default:                              โ”‚
โ”‚                                       %(levelname)s:%(name)s:%(message)s]    โ”‚
โ”‚ --version                             Print version and exit                 โ”‚
โ”‚ --help        -h                      Show this message and exit.            โ”‚
โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ

Development

uv sync
uv run pre-commit install

Acknowledgements

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wyoming_mlx_whisper-1.0.0.tar.gz (92.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wyoming_mlx_whisper-1.0.0-py3-none-any.whl (7.5 kB view details)

Uploaded Python 3

File details

Details for the file wyoming_mlx_whisper-1.0.0.tar.gz.

File metadata

  • Download URL: wyoming_mlx_whisper-1.0.0.tar.gz
  • Upload date:
  • Size: 92.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for wyoming_mlx_whisper-1.0.0.tar.gz
Algorithm Hash digest
SHA256 4eb52ce042429ff42d5e7a17e23766c371555281853c33f0bf11d0a21087db96
MD5 fc62259910e8af9b570f60c44f46467c
BLAKE2b-256 b90c8d712f182c2ef71d081bb9500b1963d1f76d7631e718acdecf003cc132ac

See more details on using hashes here.

Provenance

The following attestation bundles were made for wyoming_mlx_whisper-1.0.0.tar.gz:

Publisher: release.yml on basnijholt/wyoming-mlx-whisper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file wyoming_mlx_whisper-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for wyoming_mlx_whisper-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f8bc8f3640fe40a0711f91e7b9d6329436b31ca16928f2d4eb9d95ac418294a2
MD5 c067ed0cf0ec1be395aa9fa5b5b6f19e
BLAKE2b-256 ed795aee90794b76e631cfb4757812062dabd6e17ac2369d7e5964f9bc52905a

See more details on using hashes here.

Provenance

The following attestation bundles were made for wyoming_mlx_whisper-1.0.0-py3-none-any.whl:

Publisher: release.yml on basnijholt/wyoming-mlx-whisper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page