kloom-litellm
A LiteLLM plugin for intelligent model routing and request tracking with Kloom.
Features
- Intelligent Model Routing (LiteLLM Proxy): Automatically select the best model based on cost, performance, and availability
- Request Tracking (SDK & Proxy): Log all LLM requests and responses for analytics and monitoring
- Seamless Integration: Works with any LiteLLM-supported model provider
Quick Start
Installation
pip install kloom-litellm
Basic Usage (Request Tracking)
import litellm
from kloom_litellm import KloomPlugin
# Initialize the plugin
kloom_logger = KloomPlugin()
litellm.callbacks = [kloom_logger]
# Use LiteLLM as normal - requests will automatically be tracked
response = litellm.completion(
model="gpt-5",
messages=[{"role": "user", "content": "Hello!"}]
)
Documentation
For complete documentation, including:
- LiteLLM Proxy setup for model routing
- Configuration options
- Advanced usage examples
- Troubleshooting
Visit: https://docs.kloom.ai/quickstart/litellm
Development
Installation from Source
uv sync
License
See LICENSE file.
1 maintainer
Metadata
1 maintainer
Release files for kloom-litellm 0.0.1.post1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| kloom_litellm-0.0.1.post1.tar.gz | 9.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| kloom_litellm-0.0.1.post1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 19.4 kB
Release files / kloom_litellm-0.0.1.post1.tar.gz
| Download URL | kloom_litellm-0.0.1.post1.tar.gz |
|---|---|
| Size | 9.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
49dcded019d4784ce96e3062b0f2cbbf8c0c4beaaf040a0f5ae79a4bbedf3a5d
|
|
BLAKE2b-256 checksum How to use checksums |
ecc56c28ff20ac9105c4784647630b910dd3057a90caad87c7fd1570e7bd3f67
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.6
|
Release files / kloom_litellm-0.0.1.post1-py3-none-any.whl
| Download URL | kloom_litellm-0.0.1.post1-py3-none-any.whl |
|---|---|
| Size | 9.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
bd7ddf2956b1a8de1694be3e923497fc28c4cddfff396cbe27536373e7d22707
|
|
BLAKE2b-256 checksum How to use checksums |
562588070bf1bd8e90d0b7bf01f90fc005ecedd8c309f98d3c1d607575986cc0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.6
|
