llama-index packs ollama_query_engine integration
Project description
Ollama Query Engine Pack
Create a query engine using completely local by Ollama
CLI Usage
You can download llamapacks directly using llamaindex-cli
, which comes installed with the llama-index
python package:
llamaindex-cli download-llamapack OllamaQueryEnginePack --download-dir ./ollama_pack
You can then inspect the files at ./ollama_pack
and use them as a template for your own project.
Code Usage
You can download the pack to a the ./ollama_pack
directory:
from llama_index.core.llama_pack import download_llama_pack
# download and install dependencies
OllamaQueryEnginePack = download_llama_pack(
"OllamaQueryEnginePack", "./ollama_pack"
)
# You can use any llama-hub loader to get documents!
ollama_pack = OllamaQueryEnginePack(model="llama2", documents=documents)
From here, you can use the pack, or inspect and modify the pack in ./ollama_pack
.
The run()
function is a light wrapper around index.as_query_engine().query()
.
response = ollama_pack.run("What is the title of the book of John?")
You can also use modules individually.
# Use the llm
llm = ollama_pack.llm
response = llm.complete("What is Ollama?")
# Use the index directly
index = ollama_pack.index
query_engine = index.as_query_engine()
retriver = index.as_retriever()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_packs_ollama_query_engine-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6b2176079e4c2ffd90cbc2b6a99df212c17dd018d6f219e859dc28deea63ddc |
|
MD5 | 085a10cd33e6eca8c976148bed32c3db |
|
BLAKE2b-256 | 7dca2aa0f733c515e68168e3f0c2d83d579d25adcce454b3f8391a28885ddba8 |
Close
Hashes for llama_index_packs_ollama_query_engine-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8fdb8c3fbbef65ddef74d1db6c7245f6d386140de16aa0c343d02750324688a0 |
|
MD5 | 8a8c999382cac643e89dd1a7cb8c6d6c |
|
BLAKE2b-256 | d9a768f55bd793e912c324cc407295f2a963cfff770e22986ae3a3775ee4a526 |