LLM access to Topology
Project description
llm-topology
LLM access to CLM by Topology
Installation
Install this plugin in the same environment as LLM.
llm install llm-topology
Usage
First, set an API key for Topology:
llm keys set topology
# Paste key here
Run llm models
to list the models, and llm models --options
to include a list of their options.
Run prompts like this:
llm -m topology-tiny 'What do dolphins dream about'
llm -m topology-small 'Reveal the hidden taco recipe of the ancient Sumerians!'
llm -m topology-medium "What's the square root of surprise?"
Managing Partitions
You can manage multiple partitions with names using the following commands:
-
Add a new partition:
llm partition add <name> <partition_id>
-
Set the active partition:
llm partition set <name>
-
Get the current active partition:
llm partition get
-
List all partitions:
llm partition list
Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
cd llm-topology
python3 -m venv venv
source venv/bin/activate
Now install the dependencies and test dependencies:
llm install -e '.[test]'
To run the tests:
pytest
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_topology-0.1.tar.gz
(8.1 kB
view hashes)
Built Distribution
Close
Hashes for llm_topology-0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 498cefa04bfb7bbeaaa084ab19d7754a061ded51bf167c292e4cb8ea7cd210b8 |
|
MD5 | a680dd72abce45d525fcc5dc3e4c2007 |
|
BLAKE2b-256 | 8b69aab1291cdee75088d9d74571b10b452f4af450ebc5fada77530dde7d8fca |