LLM plugin for Anthropic's Claude on AWS Bedrock
Project description
llm-bedrock-anthropic
Plugin for LLM adding support for Anthropic's Claude models.
Installation
Install this plugin in the same environment as LLM. From the current directory
llm install llm-bedrock-anthropic
Configuration
You will need to specify AWS Configuration with the normal boto3 and environment variables.
For example, to use the region us-west-2
and AWS credentials under the personal
profile, set the environment variables
export AWS_DEFAULT_REGION=us-west-2
export AWS_PROFILE=personal
Usage
This plugin adds models called bedrock-claude
and bedrock-claude-instant
.
You can query them like this:
llm -m bedrock-claude-instant "Ten great names for a new space station"
llm -m bedrock-claude "Compare and contrast the leadership styles of Abraham Lincoln and Boris Johnson."
Options
max_tokens_to_sample
, default 8_191: The maximum number of tokens to generate before stopping
Use like this:
llm -m bedrock-claude -o max_tokens_to_sample 20 "Sing me the alphabet"
Here is the alphabet song:
A B C D E F G
H I J
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llm-bedrock-anthropic-0.4.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d76b39913e3c9db1e66c09bdbcb49ef6c984de179f00eb54f99cfb04c0f0b26 |
|
MD5 | f0df4a811d16a512ad84f61069789dc2 |
|
BLAKE2b-256 | 44d7e819d37e7a4d9b14a55de6fc9ba17eadd8ef8e88ca43510bb7e7d240771d |
Close
Hashes for llm_bedrock_anthropic-0.4.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 24e1dab29a16bec7d046c016abf5d5c7db8affa65ca909fbeda6871d8d994a0f |
|
MD5 | dada42951855bb5ee57ad7be1cf32482 |
|
BLAKE2b-256 | 7e843aaefb81591b03912a59e3aed860ddc971eabdd24bb556815e2d5abdd3ed |