llama-index packs agents llm compiler
Project description
LLMCompiler Agent Pack
This LlamaPack implements the LLMCompiler agent paper.
A lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits to the original authors for a great work!
A full notebook guide can be found here.
CLI Usage
You can download llamapacks directly using llamaindex-cli
, which comes installed with the llama-index
python package:
llamaindex-cli download-llamapack LLMCompilerAgentPack --download-dir ./llm_compiler_agent_pack
You can then inspect the files at ./llm_compiler_agent_pack
and use them as a template for your own project!
Code Usage
You can download the pack to a directory. NOTE: You must specify skip_load=True
- the pack contains multiple files,
which makes it hard to load directly.
We will show you how to import the agent from these files!
from llama_index.core.llama_pack import download_llama_pack
# download and install dependencies
download_llama_pack("LLMCompilerAgentPack", "./llm_compiler_agent_pack")
From here, you can use the pack. You can import the relevant modules from the download folder (in the example below we assume it's a relative import or the directory has been added to your system path).
# setup pack arguments
from llama_index.core.agent import AgentRunner
from llm_compiler_agent_pack.step import LLMCompilerAgentWorker
agent_worker = LLMCompilerAgentWorker.from_tools(
tools, llm=llm, verbose=True, callback_manager=callback_manager
)
agent = AgentRunner(agent_worker, callback_manager=callback_manager)
# start using the agent
response = agent.chat("What is (121 * 3) + 42?")
You can also use/initialize the pack directly.
from llm_compiler_agent_pack.base import LLMCompilerAgentPack
agent_pack = LLMCompilerAgentPack(tools, llm=llm)
The run()
function is a light wrapper around agent.chat()
.
response = pack.run("Tell me about the population of Boston")
You can also directly get modules from the pack.
# use the agent
agent = pack.agent
response = agent.chat("task")
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llama_index_packs_agents_llm_compiler-0.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a75ec16f18c57c0ddddc701f6ea5eac6df467510e18bf7deb229d8dd27d52025 |
|
MD5 | 6e9c6c126f18a68ff7990d9581ee45b8 |
|
BLAKE2b-256 | b5665f9501c2f4444b94e9b11194ab4c47b77817351124e34bc0affb174309ee |
Hashes for llama_index_packs_agents_llm_compiler-0.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | da66c6251be79badf7c3dac63dd9c71dac3e7bac06b2ba2db1cd995d6e8b173e |
|
MD5 | 0d348e1d71e146091b47ef22ace3b9fa |
|
BLAKE2b-256 | 824551ad1a03cdc29f5e6c02baa6d2de4344b62c425c181239457baca5c98273 |