3 projects
raif-vllm
One vLLM plugin for transparent RAIF token savings — install it and existing OpenAI clients get RAIF on tools & response_format with no proxy and no client changes.
raif-format
A repairable, token-efficient layer for the JSON language models produce (structured outputs, strict objects, JSON mode, tool args) — pure-Python encode/decode/fix/validate.
pyenvalid
Beautiful validation errors for pydantic-settings