llm-cohere

Plugin for LLM adding support for Cohere's Generater and Summarize models.

Installation

Install this plugin in the same environment as LLM.

llm install llm-cohere

Configuration

You will need an API key from Cohere. You can obtain one by creating an account and going to 'API Keys'.

You can set that as an environment variable called COHERE_API_KEY, or add it to the llm set of saved keys using:

llm keys set cohere

Enter key: <paste key here>

Usage

This plugin adds two models. cohere-generate uses an input prompt and generates output based on it. summarize takes an input prompt and generates a summarised response.

llm -m cohere-generate "Seven great names for a pet lemur"

Cohere also supports system prompts, which are sent to Cohere in the format of <prompt>: <system prompt>.

echo "I like lemurs a lot" | llm -m cohere-generate --system "Translate to german"

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-cohere
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

pip install -e '.[test]'