Last released Sep 13, 2024
A simple library for performing LLM batch inference using API requests.
Supported by