justai 5.4.6

Makes working with LLMs like OpenAI GPT, Anthropic Claude, Google Gemini and Open source models super easy

JustAI

Package to make working with Large Language models in Python super easy. Supports OpenAI, Anthropic Claude, Google Gemini, X Grok, DeepSeek, Perplexity, OpenRouter and open source .guff models.

Author: Hans-Peter Harmsen ([e-mail])
Current version: 5.4.6

Version 4.x is not compatible with the 3.x series.

Installation

1. Install the package:

python -m pip install justai

2. Create an OpenAI acccount (for OpenAI models) here or an Anthropic account here or a Google account
3. Create an OpenAI api key here or an Anthropic api key here or a Google api key here
4. Create a .env file with the following content, depending on the model you intend to use:

OPENAI_API_KEY=your-openai-api-key
OPENAI_ORGANIZATION=your-openai-organization-id
ANTHROPIC_API_KEY=your-anthropic-api-key
GOOGLE_API_KEY=your-google-api-key
X_API_KEY=your-x-ai-api-key
DEEPSKEEK_API_KEY=your-deepseek-api-key

Basic usage

from justai import Model

model = Model('gpt-5-mini')
model.system = """You are a movie critic. I feed you with movie
                  titles and you give me a review in 50 words."""

message = model.chat("Forrest Gump", cached=True)
print(message)

Here, cached=True specifies that justai should cache the prompt and the model's response.

output

Forrest Gump is an American classic that tells the story of
a man with a kind heart and simple mind who experiences major
events in history. Tom Hanks gives an unforgettable performance, 
making us both laugh and cry. A heartwarming and nostalgic 
movie that still resonates with audiences today.

Models

Justai can use different types of models:

OpenAI models like GPT-5 and O3

Anthropic models like the Claude-3 models

Google models like the Gemini models

X AI models like the Grok models

DeekSeek models like Deepseek V-3 (deepseek-chat) and reasoning model Deepseek-R1 (deepseek-reasoning)

Open source models like Llama2-7b or Mixtral-8x7b-instruct as long as they are in the GGUF format.

OpenRouter models. To use these use modelname 'openrouter/provider/_modelname'

Except for OpenRouter, the provider is chosen depending on the model name. E.g. if a model name starts with gpt, OpenAI is chosen as the provider. To use an open source model, just pass the full path to the .gguf file as the model name.

More advanced usage

Returning json or other types

python examples/return_types.py

You can specify a specific return type (like a list of dicts) for the completion. This is useful when you want to extract structured data from the completion.

To return structured data, just pass return_json=True to model.chat() and tell the model in the prompt how you want your json to be structured.

Example returning json data

model = Model('gemini-1.5-flash')
prompt = "Give me the main characters from Seinfeld with their characteristics. " + \
         "Return json with keys name, profession and weirdness"

data = model.chat(prompt, return_json=True)
print(json.dumps(data, indent=4))

Specifying the return type

To define a specific return type you can use the return_type parameter.

Currently this works with the Google models (pass a Python type definition, returns Json) and with OpenAI (pass a Pydatic type definition, returns a Pydantic model).

See the example code for more further examples.

Images

Pass images to the model. An image can either be:

• An url to an image
• The raw image data
• A PIL image

Example with PIL image and GPT4o-mini

    
model = Model("gpt-5-nano")
url = 'https://upload.wikimedia.org/wikipedia/commons/9/94/Common_dolphin.jpg'
image = Image.open(io.BytesIO(httpx.get(url).content))
message = model.chat("What is in this image", images=url, cached=False)
print(message)

Asynchronous use

async def print_words(model_name, prompt):
    model = Model(model_name)
    async for word in model.chat_async(prompt):
        print(word, end='')
        
prompt = "Give me 5 names for a juice bar that focuses senior citizens."
asyncio.run(print_words("sonar-pro", prompt))

Prompt caching

Shows how to use Prompt caching in Anthropic models.

model = Model('claude-3.7-sonnet')
model.system_message = "You are an experienced book analyzer"  # This is how you set the system message in justai
model.cached_prompt = SOME_STORY
res = model.chat('Who is Mr. Thompsons Neighbour? Give me just the name.',
                 cached=False)  # Disable justai's own cache
print(res)
print('input_token_count', model.input_token_count)
print('output_token_count', model.output_token_count)
print('cache_creation_input_tokens', model.cache_creation_input_tokens)
print('cache_read_input_tokens', model.cache_read_input_tokens)

Creating images

Some models can create images. You need to pass an image generating model to the Model to use it.

model = Model('gpt-5')
pil_image = model.generate_image("Create an image dolphin reading a book")

Passing other images alongside the prompt is also possible. This can be used to alter images or to do style transfer.

model = Model('gemini-2.5-flash-image-preview')
url = 'https://upload.wikimedia.org/wikipedia/commons/9/94/Common_dolphin.jpg'
image = Image.open(io.BytesIO(httpx.get(url).content))
pil_image = model.generate_image("Convert this image into the style of van Gogh", images=image)

Image input can be a single image or a list of images.
Each image can be a a url, a PIL image or raw image data.

Output is always a PIL image.