livekit-plugins-llama-index 0.2.4

Llama Index plugin for LiveKit Agents

LiveKit Plugins Llama Index

Agent Framework plugin for using Llama Index. Currently supports Query Engine and Chat Engine.

Install

pip install livekit-plugins-llama-index

Query Engine

Query Engine is primarily used for RAG. See example voice agent

Chat Engine

Chat Engine can be used as an LLM within the framework.

# load the existing index
storage_context = StorageContext.from_defaults(persist_dir=<mydir>)
index = load_index_from_storage(storage_context)

async def entrypoint(ctx: JobContext):
    ...
    chat_engine = index.as_chat_engine(chat_mode=ChatMode.CONTEXT)
    assistant = VoicePipelineAgent(
        vad=silero.VAD.load(),
        stt=deepgram.STT(),
        llm=llama_index.LLM(chat_engine=chat_engine),
        tts=openai.TTS(),
        chat_ctx=initial_ctx,
    )

full example here