llama-index agent llm compiler integration
Project description
LlamaIndex Agent Integration: LLM Compiler
This Agent integration implements the LLMCompiler agent paper.
A lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits to the original authors for a great work!
A full notebook guide can be found here.
Usage
First install the package:
pip install llama-index-agent-llm-compiler
# setup pack arguments
from llama_index.core.agent import AgentRunner
from llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker
agent_worker = LLMCompilerAgentWorker.from_tools(
tools, llm=llm, verbose=True, callback_manager=callback_manager
)
agent = AgentRunner(agent_worker, callback_manager=callback_manager)
# start using the agent
response = agent.chat("What is (121 * 3) + 42?")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_agent_llm_compiler-0.2.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6d40638fae383c7ca0d4e659cb047f549359875fcaaa3b3282a44bc35848668 |
|
MD5 | 7d3c291a0566ff823afe6bb97361778b |
|
BLAKE2b-256 | a5d800dd9c27059465a5787e1deb1ac865ef66c2d6466c85bcb49373453d1d42 |
Close
Hashes for llama_index_agent_llm_compiler-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca9d28e031fe1e6335147da8232dd2ca900fe00341e2f9eb44f88cc4053e8904 |
|
MD5 | 1e9ab424a8be83ad701595914dc2acb1 |
|
BLAKE2b-256 | 8529b1d5af31a79aed7d2bc7f121aea9c91937f184c66bdf289745cd69020423 |