Skip to main content

Agent Framework plugin for voice synthesis with Uplift AI.

Project description

LiveKit Plugins - Uplift

This plugin provides TTS integration for Uplift AI into the LiveKit Agent Framework. You can also find official documentation of Uplift API

Installation

pip install livekit-plugins-uplift

Pre-requisites

You'll need an API key from UpliftAI. It can be set as an environment variable: UPLIFT_AI_API_KEY

Urdu Script Requirements

The Uplift TTS is designed to work with Urdu script. The TTS should only receive text in Urdu script - not Roman Urdu. This can be achieved via basic prompt engineering to ensure your LLM generates output in proper Urdu script.

Example

from livekit.plugins import uplift

async def entrypoint(ctx: JobContext):
    initial_ctx = llm.ChatContext().append(
        role="system",
        text=(
            "You're an Urdu speaking livebot on a LiveKit call. "
            "No matter what, you should generate Urdu responses, in urdu script, no matter what. "
            "It should not be in Roman Urdu, it should be in Urdu script. "
        ),
    )

    await ctx.connect(auto_subscribe=AutoSubscribe.AUDIO_ONLY)

    assistant = VoicePipelineAgent(
        vad=silero.VAD.load(),
        stt=openai.STT(language="ur"),
        llm=openai.LLM(),
        tts=uplift.TTS(voice="v_30s70t3a"),
        chat_ctx=initial_ctx,
        fnc_ctx=fnc_ctx,
    )
    assistant.start(ctx.room)
    await assistant.say("ہیلو، آپ کیسے ہیں؟", allow_interruptions=True)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

livekit_plugins_uplift-0.2.1.tar.gz (9.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

livekit_plugins_uplift-0.2.1-py3-none-any.whl (11.4 kB view details)

Uploaded Python 3

File details

Details for the file livekit_plugins_uplift-0.2.1.tar.gz.

File metadata

  • Download URL: livekit_plugins_uplift-0.2.1.tar.gz
  • Upload date:
  • Size: 9.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for livekit_plugins_uplift-0.2.1.tar.gz
Algorithm Hash digest
SHA256 22d32d4552a37aaa90a679e3ed00b6b5bf69e65f141f8cad231910abe68565ea
MD5 1aa514a205441560a6f422d93eaaedd5
BLAKE2b-256 a83b395300143083c3432a67969ed05d087f3dbb7f7e232199bea969c0623d8e

See more details on using hashes here.

File details

Details for the file livekit_plugins_uplift-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for livekit_plugins_uplift-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 832480487191b0ac4312e8cd9e39e20c2c6950dd8d7ad3b4091dc72fa91678a2
MD5 5de57d61cb5a69fbf9e946aa0cadfe3c
BLAKE2b-256 a8470d34bbdf6c918fb06c423c3f8d820545144c29893af0f6a1bf303ac3c45f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page