Zoom AI plugin for LiveKit Agents

Support for Zoom Scribe speech-to-text, in two modes:

• Live (docs): streaming over WebSocket. Scribe's own VAD ends each speech turn and returns its final transcript.
• Fast (docs): one HTTP request per utterance. Not streaming, so AgentSession pairs it with a VAD.

See zoom.ai for all Zoom AI Services APIs and features.

Installation

pip install livekit-plugins-zoom-ai

Or install with the LiveKit Agents extra:

uv add "livekit-agents[zoom-ai]"

Pre-requisites

The plugin needs a Zoom AI Services API key. Create one in Zoom Platform Studio under Credentials → API Keys, with the Scribe permissions.

Set it in your .env file:

ZOOM_AI_API_KEY=<your_zoom_api_key>

Usage

Scribe Live (streaming)

Scribe detects the end of each turn, so let the STT drive turn detection:

from livekit.agents import AgentSession
from livekit.plugins import zoom_ai

session = AgentSession(
    stt=zoom_ai.STT(language="en-US"),
    turn_handling={"turn_detection": "stt"},
    # ... llm, tts, etc.
)

Scribe Fast (per utterance)

from livekit.agents import AgentSession
from livekit.plugins import silero, zoom_ai

session = AgentSession(
    stt=zoom_ai.STT(mode="fast"),
    vad=silero.VAD.load(),  # cuts the audio into utterances
    # ... llm, tts, etc.
)

Without an agent

Both modes also work on their own, for example for transcription. Outside an agent job, pass an aiohttp session:

stt = zoom_ai.STT(http_session=session, silence_duration_ms=600)  # Live
stream = stt.stream()  # push_frame() audio, then iterate the stream for SpeechEvents

event = await zoom_ai.STT(mode="fast", http_session=session).recognize(frames)  # Fast

For transcription, a longer silence_duration_ms (such as 600) keeps sentences with pauses together and can improve accuracy; the 350 ms default is tuned for voice agents.

Options

Options map to the Scribe API fields of the same name; see the Scribe docs for what each one does and its availability. For a Scribe feature without an option here, pass its fields in extra_kwargs.