Mistral AI Plugin for LiveKit Agents

Support for Mistral AI STT, TTS, and LLM services.

Installation

pip install livekit-plugins-mistralai

For streaming STT (Voxtral Realtime), also install silero plugin.

pip install livekit-plugins-silero

Pre-requisites

You'll need an API key from Mistral AI. It can be set as an environment variable:

export MISTRAL_API_KEY=your_api_key_here

Usage

Speech-to-Text (STT)

Offline transcription

from livekit.plugins import mistralai

stt = mistralai.STT()

# With context biasing
stt = mistralai.STT(
    model="voxtral-mini-latest",
    context_bias=["LiveKit", "Voxtral", "Mistral"]
)

Realtime streaming transcription

Voxtral Realtime streams interim transcripts over a WebSocket connection. Since this model has no server-side endpointing, the plugin runs an internal Silero VAD to detect when the user stops speaking and flush the audio — producing final transcripts and driving the end-of-turn pipeline.

from livekit.plugins import mistralai
from livekit.plugins.silero import VAD

# Using Silero VAD with default settings (550ms silence threshold)
stt = mistralai.STT(model="voxtral-mini-transcribe-realtime-2602")

# Using custom VAD settings (e.g. shorter silence threshold for faster responses)
stt = mistralai.STT(
    model="voxtral-mini-transcribe-realtime-2602",
    vad=VAD.load(min_silence_duration=0.3),
)

Text-to-Speech (TTS)

from livekit.plugins import mistralai

# Using a built-in voice
tts = mistralai.TTS(voice="en_paul_neutral")

# Using zero-shot voice cloning
import base64
ref_audio_b64 = base64.b64encode(open("sample.mp3", "rb").read()).decode()
tts = mistralai.TTS(ref_audio=ref_audio_b64)

LLM

from livekit.plugins import mistralai

llm = mistralai.LLM()

# With all available options
llm = mistralai.LLM(
    model="mistral-large-latest",
    temperature=0.7,
    top_p=0.9,
    max_completion_tokens=150,
    presence_penalty=0.1,
    frequency_penalty=0.1,
    random_seed=42,
    tool_choice="auto",
)

# With provider tools
agent = Agent(
    llm=llm,
    tools=[
        mistralai.tools.WebSearch(),
        mistralai.tools.CodeInterpreter(),
        mistralai.tools.DocumentLibrary(library_ids=["<your-library-id>"]),
        mistralai.tools.Connector(connector_id="<your_connector_id>")
    ]
)

Project links

Data verified by PyPI on
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.6.9)

Owner

PyPI data
Data sourced directly from PyPI's database.

Credits

Author: LiveKit

GitHub Statistics

Data verified by PyPI on 
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.10.0

Tags

ai audio livekit mistral realtime video voice

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

livekit_plugins_mistralai-1.6.5.tar.gz (12.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

livekit_plugins_mistralai-1.6.5-py3-none-any.whl (15.0 kB view details)

Uploaded Python 3

File details

Details for the file livekit_plugins_mistralai-1.6.5.tar.gz.

File metadata

File hashes

Hashes for livekit_plugins_mistralai-1.6.5.tar.gz
Algorithm Hash digest
SHA256 b0f5ea6406105596b1acee9506f74117ab3268aeded74e85602f4302a3282a8a
MD5 6d6ba043032e7bb041a403d95a25886c
BLAKE2b-256 3d724787a850f1561a7280a670335a48f88cc8b86fd14c885603d84660e50036

See more details on using hashes here.

Provenance

The following attestation bundles were made for livekit_plugins_mistralai-1.6.5.tar.gz:

Publisher: publish.yml on livekit/agents

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file livekit_plugins_mistralai-1.6.5-py3-none-any.whl.

File metadata

File hashes

Hashes for livekit_plugins_mistralai-1.6.5-py3-none-any.whl
Algorithm Hash digest
SHA256 6da8cac0103e0793c3a7c0c3a5ea2d470db7e96fb798e1ebc8b39efd70aac20c
MD5 1894d9e3692e502c3858ff418e0b79df
BLAKE2b-256 4f7fe21899630485c9bc655e4396f10d4d56304e143a400d7c70e8fdbd71ce46

See more details on using hashes here.

Provenance

The following attestation bundles were made for livekit_plugins_mistralai-1.6.5-py3-none-any.whl:

Publisher: publish.yml on livekit/agents

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

1.6.9

1.6.8

1.6.7

1.6.6

This release

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.6.0rc2 pre-release

1.6.0rc1 pre-release

1.5.19rc1 pre-release

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.5.0rc2 pre-release

1.5.0rc1 pre-release

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0rc2 pre-release

1.4.0rc1 pre-release

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0rc2 pre-release

1.3.0rc1 pre-release

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.7

1.1.5

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page