A monitoring tool for vLLM metrics.
Project description
vllm-top
vllm-top is a Python package for monitoring and displaying metrics from the vLLM service. It provides a comprehensive dashboard to visualize both current state and historical performance, making it easy to track and analyze service behavior over time.
🚀 Features
- Task State Visibility: Instantly see GPU Cache Usage, Running and Waiting requests to help debug bottlenecks and improve throughput.
- Minimalist Monitoring: Lightweight dashboard that parses metrics directly from Prometheus.
- Quick Setup: No extra configuration — just pip install and run.
📦 Installation
Install via pip:
pip install vllm-top
🛠️ Usage
Start monitoring:
vllm-top
Change update interval (in seconds):
vllm-top --interval 5
Get a one-time snapshot:
vllm-top --snapshot
🤝 Contributing
Contributions are welcome! Please submit a pull request or open an issue for enhancements or bug fixes.
📄 License
Licensed under the MIT License. See the LICENSE file for details.
📜 Changelog
See CHANGELOG.md for a detailed
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file vllm_top-0.1.2a0.tar.gz.
File metadata
- Download URL: vllm_top-0.1.2a0.tar.gz
- Upload date:
- Size: 10.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0913065e040ce3759e970baded2246c5f8aa9b78485f79487bba1e7f4b36f636
|
|
| MD5 |
43719eb08e2271134539db796a6e19ac
|
|
| BLAKE2b-256 |
a9a7f32192c8c47babec0944392caf4177605c4641c4646e25dfcb7fe309449e
|
File details
Details for the file vllm_top-0.1.2a0-py3-none-any.whl.
File metadata
- Download URL: vllm_top-0.1.2a0-py3-none-any.whl
- Upload date:
- Size: 8.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e6bc3739c1583c5d1d607be406a64bd7018bf4512aebb2c45ef2ab380d601aa3
|
|
| MD5 |
9eab69d197742c8fdd9bbe1bd8c705ff
|
|
| BLAKE2b-256 |
50c347a191e79eb3ac774680171e29ee5e7c3814dfe0c3e89cf0bc6b1da6d564
|
