LLM plugin for Anthropic's Claude
Project description
llm-claude
Plugin for LLM adding support for Anthropic's Claude models.
Installation
Install this plugin in the same environment as LLM.
llm install llm-claude
Configuration
You will need an API key from Anthropic. Request access at https://www.anthropic.com/earlyaccess then go to https://console.anthropic.com/account/keys
You can set that as an environment variable called ANTHROPIC_API_KEY
, or add it to the llm
set of saved keys using:
llm keys set claude
Enter key: <paste key here>
Usage
This plugin adds models called claude
and claude-instant
.
Anthropic describes them as:
two families of models, both of which support 100,000 token context windows:
- Claude Instant: low-latency, high throughput
- Claude: superior performance on tasks that require complex reasoning
You can query them like this:
llm -m claude-instant "Ten great names for a new space station"
llm -m claude "Compare and contrast the leadership styles of Abraham Lincoln and Boris Johnson."
Options
max_tokens_to_sample
, default 10_000: The maximum number of tokens to generate before stopping
Use like this:
llm -m claude -o max_tokens_to_sample 20 "Sing me the alphabet"
Here is the alphabet song:
A B C D E F G
H I J
Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
cd llm-claude
python3 -m venv venv
source venv/bin/activate
Now install the dependencies and test dependencies:
pip install -e '.[test]'
To run the tests:
pytest
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llm_claude-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 66780648bef588aff6d15aa37596d80ab427879a84272889f45b574c83bcef36 |
|
MD5 | 926a2924379bf0a383f30f013d5a2a98 |
|
BLAKE2b-256 | 753dbe9dac40df5c4c4ea40188252f6dfa541cd86d3591c28ba04ae2c3fd64a6 |