Wirtual Plugins Llama Index
Agent Framework plugin for using Llama Index. Currently supports Query Engine and Chat Engine.
Install
pip install wirtual-plugins-llama-index
Query Engine
Query Engine is primarily used for RAG. See example voice agent
Chat Engine
Chat Engine can be used as an LLM within the framework.
# load the existing index
storage_context = StorageContext.from_defaults(persist_dir=<mydir>)
index = load_index_from_storage(storage_context)
async def entrypoint(ctx: JobContext):
...
chat_engine = index.as_chat_engine(chat_mode=ChatMode.CONTEXT)
assistant = VoicePipelineAgent(
vad=silero.VAD.load(),
stt=deepgram.STT(),
llm=llama_index.LLM(chat_engine=chat_engine),
tts=openai.TTS(),
chat_ctx=initial_ctx,
)
full example here
1 maintainer
Metadata
1 maintainer
Release files for wirtual-plugins-llama-index 0.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| wirtual_plugins_llama_index-0.0.1.tar.gz | 4.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| wirtual_plugins_llama_index-0.0.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.2 kB
Release files / wirtual_plugins_llama_index-0.0.1.tar.gz
| Download URL | wirtual_plugins_llama_index-0.0.1.tar.gz |
|---|---|
| Size | 4.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2c6511ff1de114f658fe6e59981dd6ef8d64a3c2e6dca42c005170d6d5bc979b
|
|
BLAKE2b-256 checksum How to use checksums |
b539b5e4212777e1f2cf38d90474fadcd6d63868369c0c20aee5fc1eabf986ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.0.1 CPython/3.11.11
|
Release files / wirtual_plugins_llama_index-0.0.1-py3-none-any.whl
| Download URL | wirtual_plugins_llama_index-0.0.1-py3-none-any.whl |
|---|---|
| Size | 4.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9401c344fd5276e964f06b867dd0c9ccbf9e9d790b63b70f40600fc8a8aef4b4
|
|
BLAKE2b-256 checksum How to use checksums |
2b2ae33d8734ff057783965394ef09cb5329eab0e9ad92dcf10454b08a29702b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.0.1 CPython/3.11.11
|
