llm-xai

LLM plugin to access xAI's models

Installation

First, install the LLM command-line utility.

Now install this plugin in the same environment as LLM.

llm install llm-xai

Configuration

You will need an API key from xAI. You can obtain one here.

You can set that as an environment variable called XAI_KEY, or add it to the llm set of saved keys using:

llm keys set xai

Enter key: <paste key here>

Usage

To list available models, run:

llm models list

You should see a list that looks something like this:

xAI: xAI/grok-beta
xAI: xAIcompletion/grok-beta
...

To run a prompt against a model, pass its full model ID to the -m option, like this:

llm chat -m xAI/grok-beta

Enter your prompt, and have a chat:

Chatting with xAI/grok-beta
Type 'exit' or 'quit' to exit
Type '!multi' to enter multiple lines, then '!end' to finish
> sup playa
Hey, what's up?
>

xAI offers a completion endpoint.

llm -m xAIcompletion/grok-beta "You must know this about me:"

 I’m not a fan of being alone. I have a hard time finding peace in the silence. My own thoughts drive me crazy. But I knew I had to do this for myself. I had to prove to myself that I could be alone and be okay with it
...

You can set a shorter alias for a model using the llm aliases command like so:

llm aliases set grok xAI/grok-beta

Now you can prompt Claude using:

cat llm_xai.py | llm -m grok-beta -s 'write some pytest tests for this'

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-xai
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

pip install -e '.[test]'

To run the tests:

pytest