llm-catalog-litellm
LiteLLM CustomLLM plugin for llm-catalog.
One implementation serves both in-process use and the central proxy.
For in-process use, call register() once to wire the handler into LiteLLM.
from llm_catalog.litellm import register
register() # reads ai-sdk-catalog.json (LLM_CATALOG_CONFIG or default path)
import litellm
resp = litellm.completion(
model="examplegw/fast",
messages=[{"role": "user", "content": "hi"}],
)
For the proxy, reference llm_catalog.litellm.handler from config.yaml's custom_provider_map (no register() call needed).
The handler resolves each model from ai-sdk-catalog.json itself (the JSON config shared verbatim with — and named after — ai-sdk-catalog; the legacy llm-catalog.json remains a deprecated fallback), so the proxy config never needs gateway details in litellm_params, sidestepping LiteLLM issue #18216.
See the repository README for the proxy operations guide and the verification notes (§9), including whether LiteLLM honours a custom httpx client (the route-1/route-2 decision in §6.2).
import namespace: llm_catalog.litellm
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llm_catalog_litellm-0.6.1.tar.gz.
File metadata
- Download URL: llm_catalog_litellm-0.6.1.tar.gz
- Upload date:
- Size: 11.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
963fb49c554d7c865e8b0a2c53d63d881b7f6b27f9d9eddb23534b67499d6e05
|
|
| MD5 |
361d5c4a74fc80362ddb57c54b5eaba2
|
|
| BLAKE2b-256 |
e1efbaf02eda3fa9fab831a22b6a110dbfa5695dc36baaa3a9760d97a1efe04a
|
File details
Details for the file llm_catalog_litellm-0.6.1-py3-none-any.whl.
File metadata
- Download URL: llm_catalog_litellm-0.6.1-py3-none-any.whl
- Upload date:
- Size: 13.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
82b508b5a72797c7a2aa421f69787646b84ea25fcf681851e9283e59b5bfce59
|
|
| MD5 |
e2154cc6855ae98e9d49a2fb032c759b
|
|
| BLAKE2b-256 |
be7cc74fc7816d512b6b656c68dd00b0fe80918461683021023184bffc70d91b
|
