llm-bedrock 0.1a0

Run prompts against models hosted on AWS Bedrock

llm-bedrock

Run prompts against models hosted on AWS Bedrock

Installation

Install this plugin in the same environment as LLM.

llm install llm-bedrock

Usage

You'll need an access key and a secret key to use this plugin, with permission granted to access the Bedrock models. These step by step instructions can help you obtain those credentials.

Combine those into a access_key:secret_key format (joined by a colon) and paste that into:

llm keys set bedrock
# paste access_key:secret_key here

Run llm models to see the list of models. Run a prompt like this:

llm -m us.amazon.nova-pro-v1:0 'a happy poem about a pelican with a secret'

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-bedrock
python -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

python -m pytest