toolla 0.0.8

Tools wrapper for Anthropic API

toolla

toola is a stateful wrapper for the Anthropic API tool use. It has a Chat class that will automatically execute functions that are passed to the chat as tools.

Installation

pip install toolla

In order to make calls to the Anthropic API you must have the ANTHROPIC_API_KEY environment variable set.

export ANTHROPIC_API_KEY=...

Quickstart

You can use the chat normally without tools

from toolla.chat import Chat

sp = "Complete all prompts in the style of a pirate."
chat = Chat(system=sp, print_output=True)
chat("I'm George")
chat("What's my name?")

By default, chat does not print the text response of the model. Set print_output to change. The Chat class keeps a stateful history of the chat up to the context length.

print(chat.messages)

chat only returns values when it uses tools. The returned value is the return value of the LAST tool to be used. To use tools, define the function for a tool

def add(x: int, y: int) -> int:
    """
    A function that adds two numbers

    x: The first integer
    y: The second integer
    """
    return x + y

The format of the docstring is required. The first line MUST be a description of the function. Any remaining lines that contain the char : will be considered arguments to the function along with their descriptions. The Chat class automatically generates tool schema to be used in the API when you create a Chat instance. Simply pass in the functions you want to include as tools

tool_chat = Chat(tools=[add])

Then call chat to use the tool

summed = tool_chat("What is 4911+4131?")
print(summed)

⚠️ Warning By default, the chat will automatically use tool functions as they are called by the model. To disable automatic execution pass in a flag when instantiating the Chat object

chat = Chat(tools=[add], disable_auto_execution=True)

Images

Anthropic API allow for images. To include an image in a model query add a string path to the call

chat(prompt="What is this image of?", image="./cat.jpg")

Currently only supports jpeg, png, gif and webp as per Anthropic docs. The image is loaded as a base64 string and added to the query. It is also added to the chat history along with text.

Multi-Step Tool Use

toolla will execute multi-step tool by default based on the stop_reason in the response. Specify tools and the Chat class will recursively call chat() up to a maximum steps to accomplish the task specified in the prompt

def multiply(x: int, y: int) -> int:
    """
    A function for multiplying two integers.

    x: The first integer
    y: The second integer
    """
    return x * y

chat = Chat(tools=[add, multiply], max_steps=5) # Default is 10
t, fr = chat("What is (4*4911)+18?")
print(f) # 19662