llama-index packs rag cli local integration
Project description
RAG Local CLI Pack
This LlamaPack implements a fully local version of our RAG CLI, with Mistral (through Ollama) and BGE-M3.
CLI Usage
You can download llamapacks directly using llamaindex-cli
, which comes installed with the llama-index
python package:
llamaindex-cli download-llamapack LocalRAGCLIPack --download-dir ./local_rag_cli_pack
You can then inspect the files at ./local_rag_cli_pack
and use them as a template for your own project!
Code Usage
You can download the pack to a directory. NOTE: You must specify skip_load=True
- the pack contains multiple files,
which makes it hard to load directly.
We will show you how to import the agent from these files!
from llama_index.llama_pack import download_llama_pack
# download and install dependencies
download_llama_pack("LocalRAGCLIPack", "./local_rag_cli_pack", skip_load=True)
From here, you can use the pack. The most straightforward way is through the CLI. You can directly run base.py, or run the setup_cli.sh
script.
cd local_rag_cli_pack
# option 1
python base.py rag -h
# option 2 - you may need sudo
# default name is lcli_local
sudo sh setup_cli.sh
lcli_local rag -h
You can also directly get modules from the pack.
from local_rag_cli_pack.base import LocalRAGCLIPack
pack = LocalRAGCLIPack(
verbose=True, llm_model_name="mistral", embed_model_name="BAAI/bge-m3"
)
# will spin up the CLI
pack.run()
# get modules
rag_cli = pack.get_modules()["rag_cli"]
rag_cli.cli()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llama_index_packs_rag_cli_local-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 156c8b1bf1431d154967528bdedce34db75079112709ead1d9414ceb4d6f6dc8 |
|
MD5 | 98dbfa2033eb8488463180874b174be9 |
|
BLAKE2b-256 | 3797e4edef8b1b2f3fafb8f7e1a55eb719bc5fde73b2288abd4d6506376d9e0c |
Hashes for llama_index_packs_rag_cli_local-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a97e5afe2c7feb1e25bdc606d9e11cd885ed06e8afd1c7f9c4c6a39b288655a0 |
|
MD5 | 017292c02730c6e9a313c80bf28be7be |
|
BLAKE2b-256 | 2ce396212a43dfe373f083ffa0381dd184991a6eaec8fcbd34f6266b631179dd |