livekit-plugins-gnani 1.5.19rc1

LiveKit Agents plugin for Gnani Vachana speech AI — STT & TTS for Indian languages

livekit-plugins-gnani

LiveKit Agents plugin for Gnani Vachana — high-accuracy Speech-to-Text and low-latency Text-to-Speech for Indian languages.

Vachana is a production-ready speech AI platform by Gnani.ai supporting 10+ Indian languages with real-time streaming, multilingual transcription, and code-switching capabilities.

Installation

pip install livekit-plugins-gnani

This will also install the websockets and livekit-agents packages as dependencies.

Prerequisites

You need a Gnani API key. Email [e-mail] to get started — all new accounts receive free credits, no credit card required.

Set your credentials as environment variables:

export GNANI_API_KEY="your-api-key"

# For REST STT only (optional):
export GNANI_ORGANIZATION_ID="your-org-id"
export GNANI_USER_ID="your-user-id"

Quick Start

Speech-to-Text

from livekit.plugins.gnani import STT

stt = STT(language="hi-IN")

# Use with a LiveKit voice agent pipeline

Text-to-Speech

from livekit.plugins.gnani import TTS

# REST (default) — single-request batch synthesis
tts = TTS(voice="Karan")

# SSE — streaming via Server-Sent Events (lower latency)
tts = TTS(voice="Karan", synthesize_method="sse")

# WebSocket — real-time streaming via stream() (lowest latency)
tts = TTS(voice="Karan", synthesize_method="websocket")

All three modes work with the standard LiveKit voice agent pipeline. The synthesize_method controls which transport synthesize() uses (REST, SSE, or WebSocket). The stream() method always uses WebSocket regardless of this setting.

Features

STT

• Batch recognition — REST API (POST /stt/v3) for file-based transcription
• Real-time streaming — WebSocket API for live audio transcription with VAD
• 10 Indian languages — bn-IN, en-IN, gu-IN, hi-IN, kn-IN, ml-IN, mr-IN, pa-IN, ta-IN, te-IN
• Code-switching — Hinglish (en-hi-IN-latn) and Hindi-English mixed (en-hi-in-cm) for streaming
• Sample rates — 8 kHz and 16 kHz

TTS

• REST synthesis — single-request batch audio generation (synthesize_method="rest")
• SSE streaming — lower-latency chunked synthesis via Server-Sent Events (synthesize_method="sse")
• WebSocket synthesis — lowest-latency synthesis via synthesize_method="websocket" or the stream() method
• 6 voices — Karan, Simran, Nara, Riya, Viraj, Raju
• Configurable output — sample rate (8000–44100), encoding (linear_pcm, oggopus), container (raw, mp3, wav, mulaw, ogg)

Supported Languages

Language	Code
Bengali	bn-IN
English (India)	en-IN
Gujarati	gu-IN
Hindi	hi-IN
Kannada	kn-IN
Malayalam	ml-IN
Marathi	mr-IN
Punjabi	pa-IN
Tamil	ta-IN
Telugu	te-IN

Available Voices

Voice	ID	Gender	Description
Karan	Karan	Male	Bold, Trustworthy
Simran	Simran	Female	Confident, Bright
Nara	Nara	Female	Gentle, Expressive
Riya	Riya	Female	Cheerful, Energetic
Viraj	Viraj	Male	Commanding, Dynamic
Raju	Raju	Male	Grounded, Conversational

Architecture

This plugin directly implements the Gnani Vachana REST and WebSocket APIs using aiohttp (for batch STT/TTS) and websockets (for streaming STT/TTS), adapting them into LiveKit's stt.STT and tts.TTS base classes. No external SDK is required — all connection logic, authentication, and audio format handling is self-contained.

Documentation

• Vachana API Docs
• LiveKit Agents Docs

License

Apache 2.0 — see LICENSE.