open-asr-server 0.1.0

OpenAI-compatible ASR server with pluggable local backends.

Open ASR Server

OpenAI-compatible ASR server with pluggable local transcription backends.

Install

Base install includes the API server and shared models/formatters:

uv tool install "open-asr-server"

Add backend extras as needed:

uv tool install "open-asr-server[parakeet]"
uv tool install "open-asr-server[whisper]"
uv tool install "open-asr-server[lightning-whisper]"

Note: the Whisper extras currently require Python 3.11 (tiktoken build constraints on 3.12+).

Whisper troubleshooting

If uv run --extra whisper fails on Python 3.12+, use a 3.11 interpreter for now:

uv run --python 3.11 --extra whisper -- open-asr-server serve --host 127.0.0.1 --port 8000

Run

uv tool run open-asr-server serve --host 127.0.0.1 --port 8000

Environment variables:

• OPENAI_ASR_SERVER_DEFAULT_MODEL: default model ID for requests
• OPENAI_ASR_SERVER_PRELOAD: comma-separated models to preload at startup

Backend options

Model IDs determine which backend is used:

• Parakeet MLX: mlx-community/parakeet-tdt-0.6b-v3 (default) or parakeet-*
• MLX Whisper: whisper-large-v3-turbo or mlx-community/whisper-large-v3-turbo
• Lightning Whisper MLX: lightning-whisper-distil-large-v3

API compatibility

The server implements:

• POST /v1/audio/transcriptions
• GET /v1/models

Example:

curl -s -X POST "http://127.0.0.1:8000/v1/audio/transcriptions" \
  -F "file=@audio.wav" \
  -F "model=whisper-large-v3-turbo"

Release

uv version --bump patch
uv run --extra dev pytest
uv build --no-sources
uv publish --index testpypi --token "$UV_PUBLISH_TOKEN"
uv publish --token "$UV_PUBLISH_TOKEN"