LiveKit Plugins Llama Index
Agent Framework plugin for using Llama Index. Currently supports Query Engine and Chat Engine.
Install
pip install livekit-plugins-llama-index
Query Engine
Query Engine is primarily used for RAG. See example voice agent
Chat Engine
Chat Engine can be used as an LLM within the framework.
# load the existing index
storage_context = StorageContext.from_defaults(persist_dir=<mydir>)
index = load_index_from_storage(storage_context)
async def entrypoint(ctx: JobContext):
...
chat_engine = index.as_chat_engine(chat_mode=ChatMode.CONTEXT)
assistant = VoicePipelineAgent(
vad=silero.VAD.load(),
stt=deepgram.STT(),
llm=llama_index.LLM(chat_engine=chat_engine),
tts=openai.TTS(),
chat_ctx=initial_ctx,
)
full example here
Release files for livekit-plugins-llama-index 0.2.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| livekit_plugins_llama_index-0.2.4.tar.gz | 4.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| livekit_plugins_llama_index-0.2.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.1 kB
Release files / livekit_plugins_llama_index-0.2.4.tar.gz
| Download URL | livekit_plugins_llama_index-0.2.4.tar.gz |
|---|---|
| Size | 4.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0cd8eaeea0568bc7e3741efb2419851e3dcfdc10ab4227d01a437f8b23b0bfc5
|
|
BLAKE2b-256 checksum How to use checksums |
dd3707d9fa9a1847fd7536b0163f2c59acbaa55878c4a4931712f4020cdc44c3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.8
|
Release files / livekit_plugins_llama_index-0.2.4-py3-none-any.whl
| Download URL | livekit_plugins_llama_index-0.2.4-py3-none-any.whl |
|---|---|
| Size | 4.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fc51196098989f785524b751c06c8ed4f597312668ce656a99fe2ed8099430ac
|
|
BLAKE2b-256 checksum How to use checksums |
2d7e10b5d6fdaec4a8f3f2704fce496e6857ce1a8fe3c7848bff6f2e34ad28b9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.8
|
