llm-bedrock-nova

Plugin for LLM adding support for Amazon's Nova models.

New: Nova Models Support

Nova models available on us-east-1

Installation

Install this plugin in the same environment as LLM. From the current directory

llm install llm-bedrock-nova

Configuration

You will need to specify AWS Configuration with the normal boto3 and environment variables.

For example, to use the region us-east-1 and AWS credentials under the personal profile, set the environment variables

export AWS_DEFAULT_REGION=us-east-1
export AWS_PROFILE=personal

Usage

This plugin adds models called bedrock-nova.

You can query them like this:

llm -m nova-micro "Ten great names for a new space station"

Options

• max_tokens_to_sample, default 8_191: The maximum number of tokens to generate before stopping

Use like this:

llm -m nova-lite -o max_tokens_to_sample 20 "Sing me the alphabet"
 Here is the alphabet song:

A B C D E F G
H I J

Support Models

• Amazon Nova Pro
• Amazon Nova Lite
• Amazon Nova micro