llm-all-models-async 0.1

Make all LLM sync models available as async

llm-all-models-async

Make all LLM sync models available as async

Installation

Install this plugin in the same environment as LLM.

llm install llm-all-models-async

Usage

Once installed, any other model plugins that do not define both sync and async models (for example llm-mrchatterbox) will gain an async version. Under the hood this uses a thread pool.

Development

To set up this plugin locally, first checkout the code. Then run the tests:

cd llm-all-models-async
uv run pytest