livekit-plugins-sarvam 1.5.8

Agent Framework plugin for services using Sarvam.ai's API.

Sarvam.ai Plugin for LiveKit Agents

Support for Sarvam.ai's Indian-language voice AI services in LiveKit Agents.

Features

• Speech-to-Text (STT): Convert audio to text using Sarvam's "Saarika" models. See the STT docs for more information.
• Text-to-Speech (TTS): Convert text to audio using Sarvam's "Bulbul" models. See the TTS docs for more information.
• LLM (Chat Completions): OpenAI-compatible chat-completions support for sarvam-30b, sarvam-30b-16k, sarvam-105b and sarvam-105b-32k including tool calling.

Installation

pip install livekit-plugins-sarvam

Pre-requisites

You'll need an API key from Sarvam.ai. It can be set as an environment variable: SARVAM_API_KEY

LLM Usage

from livekit.plugins import sarvam

llm = sarvam.LLM(
    model="sarvam-30b",  # or `sarvam-30b-16k`, `sarvam-105b`, `sarvam-105b-32k`
)

sarvam-30b, sarvam-30b-16k, sarvam-105b, and sarvam-105b-32k support tool calling via the standard OpenAI-style tools and tool_choice parameters.