llm-flexai

LLM plugin for models hosted by FlexAI.

Installation

Install this plugin in the same environment as LLM:

llm install llm-flexai

Configuration

You will need an API key from platform.flex.ai. Set it like this:

llm keys set flexai
# Paste your key here

You can also set the FLEXAI_API_KEY environment variable instead.

Usage

The list of models is fetched live from GET https://api.flex.ai/v1/models and cached for an hour. Every chat model is available with a flexai/ prefix. To see them:

llm models -q flexai/

Run a prompt:

llm -m flexai/DeepSeek-V4-Flash-0731 "Five fun names for a pet pelican"

Start a chat:

llm chat -m flexai/gpt-oss-120b

Tools

FlexAI chat models support tool calling:

llm -m flexai/DeepSeek-V4-Flash-0731 -T llm_version "What version of LLM is this?" --td

Images

Models where image input has been verified accept image attachments (PNG, JPEG, WebP):

llm -m flexai/Qwen3.6-27B-FP8 "Describe this image" -a photo.jpg

The verified models are listed in VISION_MODELS in llm_flexai.py.

Options

Models that support it take a reasoning_effort option:

llm -m flexai/gpt-oss-120b -o reasoning_effort low "Explain RAID 5 in one paragraph"

Models that support structured outputs work with --schema:

llm -m flexai/DeepSeek-V4-Flash-0731 --schema 'name, age int' "Invent a dog"

Embeddings

The bge-m3 embedding model is available as flexai/bge-m3:

llm embed -m flexai/bge-m3 -c "hello world"

Commands

llm flexai models          # list FlexAI models and their capabilities
llm flexai models --json   # the raw /v1/models response
llm flexai refresh         # refresh the cached model list

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-flexai
python -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

pip install -e '.[test]'

To run the tests:

pytest

The tests mock every HTTP request and make no network calls.

About FlexAI

FlexAI runs open models behind an OpenAI-compatible API at https://api.flex.ai/v1. Documentation: docs.flex.ai.