llm-catalog-litellm 0.2.0

LiteLLM CustomLLM plugin for llm-catalog: drive a catalog.yaml through LiteLLM, in-process or via the proxy config.yaml.

llm-catalog-litellm

LiteLLM CustomLLM plugin for llm-catalog. One implementation serves both in-process use and the central proxy.

For in-process use, call register() once to wire the handler into LiteLLM.

from llm_catalog.litellm import register

register()   # reads catalog.yaml (LLM_CATALOG_CONFIG or default path)

import litellm

resp = litellm.completion(
    model="examplegw/fast",
    messages=[{"role": "user", "content": "hi"}],
)

For the proxy, reference llm_catalog.litellm.handler from config.yaml's custom_provider_map (no register() call needed).

The handler resolves each model from catalog.yaml itself, so the proxy config.yaml never needs gateway details in litellm_params, sidestepping LiteLLM issue #18216.

See the repository README for the proxy operations guide and the verification notes (§9), including whether LiteLLM honours a custom httpx client (the route-1/route-2 decision in §6.2).

import namespace: llm_catalog.litellm