llama-index packs rag cli local integration
Project description
RAG Local CLI Pack
This LlamaPack implements a fully local version of our RAG CLI, with Mistral (through Ollama) and BGE-M3.
CLI Usage
You can download llamapacks directly using llamaindex-cli
, which comes installed with the llama-index
python package:
llamaindex-cli download-llamapack LocalRAGCLIPack --download-dir ./local_rag_cli_pack
You can then inspect the files at ./local_rag_cli_pack
and use them as a template for your own project!
Code Usage
You can download the pack to a directory. NOTE: You must specify skip_load=True
- the pack contains multiple files,
which makes it hard to load directly.
We will show you how to import the agent from these files!
from llama_index.llama_pack import download_llama_pack
# download and install dependencies
download_llama_pack("LocalRAGCLIPack", "./local_rag_cli_pack", skip_load=True)
From here, you can use the pack. The most straightforward way is through the CLI. You can directly run base.py, or run the setup_cli.sh
script.
cd local_rag_cli_pack
# option 1
python base.py rag -h
# option 2 - you may need sudo
# default name is lcli_local
sudo sh setup_cli.sh
lcli_local rag -h
You can also directly get modules from the pack.
from local_rag_cli_pack.base import LocalRAGCLIPack
pack = LocalRAGCLIPack(
verbose=True, llm_model_name="mistral", embed_model_name="BAAI/bge-m3"
)
# will spin up the CLI
pack.run()
# get modules
rag_cli = pack.get_modules()["rag_cli"]
rag_cli.cli()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llama_index_packs_rag_cli_local-0.1.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d4c8dae9da3e2acc2fd955dbfe8d2b2240f69eb854ec96c97d69dd158430b62f |
|
MD5 | 2efc3bffe756743ecc2aef93d2b786b2 |
|
BLAKE2b-256 | 6eb09a7087f10b578961265c0e018e013035e5d2430b74c8a1d1c429dc100ff8 |
Hashes for llama_index_packs_rag_cli_local-0.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b5401b70900f61abc1d72874344c806e0aee702efa787cf92d07ea58352840c5 |
|
MD5 | b391fba46ff55c0207c3ad73ec31e33d |
|
BLAKE2b-256 | ca18fe254a0ce8679e05e9e10c394b8da0ec820601da945dcba7cd8cdf13e85e |