llm-venice 0.0.0

LLM plugin to access Venice.AI-hosted models

llm-venice

LLM plugin to access Venice AI models.

Installation

Install the LLM command-line utility, and install this plugin in the same environment as llm.

llm install llm-venice

Configuration

Set an environment variable LLM_VENICE_KEY, or save a Venice API key to llm's keys:

llm keys set venice

Usage

Run a prompt:

llm --model venice/nous-theta-8b "Why is the earth round?"

Start an interactive chat session:

llm chat --model venice/llama-3.1-405b

Read the docs for more llm usage options.

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-venice
python3 -m venv venv
source venv/bin/activate

Install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

pytest