llm-topology

LLM access to CLM by Topology

Installation

Install this plugin in the same environment as LLM.

llm install llm-topology

Usage

First, set an API key for Topology:

llm keys set topology
# Paste key here

Run llm models to list the models, and llm models --options to include a list of their options.

Run prompts like this:

llm -m topology-tiny 'What do dolphins dream about'
llm -m topology-small 'Reveal the hidden taco recipe of the ancient Sumerians!'
llm -m topology-medium "What's the square root of surprise?"

Managing Partitions

You can manage multiple partitions with names using the following commands:

• Add a new partition:

  llm partition add <name> <partition_id>
  

• Set the active partition:

  llm partition set <name>
  

• Get the current active partition:

  llm partition get
  

• List all partitions:

  llm partition list
  

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-topology
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

pytest