llama-index packs zephyr_query_engine integration
Project description
Zephyr Query Engine Pack
Create a query engine using completely local and private models -- HuggingFaceH4/zephyr-7b-beta
for the LLM and BAAI/bge-base-en-v1.5
for embeddings.
CLI Usage
You can download llamapacks directly using llamaindex-cli
, which comes installed with the llama-index
python package:
llamaindex-cli download-llamapack ZephyrQueryEnginePack --download-dir ./zephyr_pack
You can then inspect the files at ./zephyr_pack
and use them as a template for your own project.
Code Usage
You can download the pack to a the ./zephyr_pack
directory:
from llama_index.core.llama_pack import download_llama_pack
# download and install dependencies
ZephyrQueryEnginePack = download_llama_pack(
"ZephyrQueryEnginePack", "./zephyr_pack"
)
# You can use any llama-hub loader to get documents!
zephyr_pack = ZephyrQueryEnginePack(documents)
From here, you can use the pack, or inspect and modify the pack in ./zephyr_pack
.
The run()
function is a light wrapper around index.as_query_engine().query()
.
response = zephyr_pack.run(
"What did the author do growing up?", similarity_top_k=2
)
You can also use modules individually.
# Use the llm
llm = zephyr_pack.llm
response = llm.complete("What is HuggingFace?")
# Use the index directly
index = zephyr_pack.index
query_engine = index.as_query_engine()
retriver = index.as_retriever()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llama_index_packs_zephyr_query_engine-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4a37d1606a0f671ba94aecc7eb60cbb5a16357166b5c8b073a03ea5bb5032127 |
|
MD5 | ea28899c89048c5f09830ce002bed665 |
|
BLAKE2b-256 | edc531dd8f1a28509e9c8aab5a3bd6d3512a9e4939a106d93fda36ff62b6641a |
Hashes for llama_index_packs_zephyr_query_engine-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9983d49fe69e49f382dce0b2683e4ebcacbafad7022c1e7bc982b8721607ac7 |
|
MD5 | 5dd92a47c3565633fadba731b0b3a080 |
|
BLAKE2b-256 | 9176cefaaca43cd4bdbc592797f35a9c47e69aa0009f1a280e75439bf9f7fc35 |