9 projects
kani
kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool usage/function calling.
fanoutqa
The companion code for the FanOutQA dataset + benchmark for LLMs.
raid-bench
RAID is the largest and most challenging benchmark for machine-generated text detectors.
redel
A toolkit for recursive delegation of LLMs
kani-ratelimits
A wrapper engine to enforce request-based, token-based, and concurrency-based limits on kani engines.
kani-vision
Kani extension for supporting vision-language models (VLMs). Comes with model-agnostic support for GPT-Vision and LLaVA.
zhu
fastlmi
A FastAPI-based framework for quickly building and iterating on language model interfaces.
d20
A formal grammar-based dice parser and roller for D&D and other dice systems.
