Skip to main content

Mistral AI Plugin for LiveKit Agents

Support for Mistral AI STT, TTS, and LLM services.

Installation

pip install livekit-plugins-mistralai

For streaming STT (Voxtral Realtime), also install silero plugin.

pip install livekit-plugins-silero

Pre-requisites

You'll need an API key from Mistral AI. It can be set as an environment variable:

export MISTRAL_API_KEY=your_api_key_here

Usage

Speech-to-Text (STT)

Offline transcription

from livekit.plugins import mistralai

stt = mistralai.STT()

# With context biasing
stt = mistralai.STT(
    model="voxtral-mini-latest",
    context_bias=["LiveKit", "Voxtral", "Mistral"]
)

Realtime streaming transcription

Voxtral Realtime streams interim transcripts over a WebSocket connection. Since this model has no server-side endpointing, the plugin runs an internal Silero VAD to detect when the user stops speaking and flush the audio — producing final transcripts and driving the end-of-turn pipeline.

from livekit.plugins import mistralai
from livekit.plugins.silero import VAD

# Using Silero VAD with default settings (550ms silence threshold)
stt = mistralai.STT(model="voxtral-mini-transcribe-realtime-2602")

# Using custom VAD settings (e.g. shorter silence threshold for faster responses)
stt = mistralai.STT(
    model="voxtral-mini-transcribe-realtime-2602",
    vad=VAD.load(min_silence_duration=0.3),
)

Text-to-Speech (TTS)

from livekit.plugins import mistralai

# Using a built-in voice
tts = mistralai.TTS(voice="en_paul_neutral")

# Using zero-shot voice cloning
import base64
ref_audio_b64 = base64.b64encode(open("sample.mp3", "rb").read()).decode()
tts = mistralai.TTS(ref_audio=ref_audio_b64)

LLM

from livekit.plugins import mistralai

llm = mistralai.LLM()

# With all available options
llm = mistralai.LLM(
    model="mistral-large-latest",
    temperature=0.7,
    top_p=0.9,
    max_completion_tokens=150,
    presence_penalty=0.1,
    frequency_penalty=0.1,
    random_seed=42,
    tool_choice="auto",
)

# With provider tools
agent = Agent(
    llm=llm,
    tools=[
        mistralai.tools.WebSearch(),
        mistralai.tools.CodeInterpreter(),
        mistralai.tools.DocumentLibrary(library_ids=["<your-library-id>"]),
        mistralai.tools.Connector(connector_id="<your_connector_id>")
    ]
)

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

livekit_plugins_mistralai-1.6.6.tar.gz (12.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

livekit_plugins_mistralai-1.6.6-py3-none-any.whl (15.0 kB view details)

Uploaded Python 3

File details

Details for the file livekit_plugins_mistralai-1.6.6.tar.gz.

File metadata

File hashes

Hashes for livekit_plugins_mistralai-1.6.6.tar.gz
Algorithm Hash digest
SHA256 cf57226dd442777e97bfd161811a36528644522a878c7447aaf6bf1c83230227
MD5 c0a97b77a3db5fae5747445c4053c127
BLAKE2b-256 1580fbdadb1a48a907c8473d5d4b8ad33e3ad43d28e7727f4ffc236b7f5e73a9

See more details on using hashes here.

Provenance

The following attestation bundles were made for livekit_plugins_mistralai-1.6.6.tar.gz:

Publisher: publish.yml on livekit/agents

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file livekit_plugins_mistralai-1.6.6-py3-none-any.whl.

File metadata

File hashes

Hashes for livekit_plugins_mistralai-1.6.6-py3-none-any.whl
Algorithm Hash digest
SHA256 04089c020d77e84d5678268ab237d039bcee15eac8adc85e8662f425033cf914
MD5 94abfe707c1a423a7f73a910614adefc
BLAKE2b-256 18c0ed51508f8ca874b5044a8ccd3ab1e8fdd0505870fe7b56e922eb1beb4761

See more details on using hashes here.

Provenance

The following attestation bundles were made for livekit_plugins_mistralai-1.6.6-py3-none-any.whl:

Publisher: publish.yml on livekit/agents

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page