This release is a pre-release and may not be stable for production use.
This library allows tracing and metrics collection for vLLM LLM serving framework.
Installation
pip install opentelemetry-instrumentation-vllm
Features
Works with vLLM 0.7.x–0.10.x (set VLLM_USE_V1=1 to opt into the v1 engine when running 0.8.x–0.10.x).
Captures spans for non-streaming and streaming create_completion and create_chat_completion calls, including prompt/response bodies, token usage and finish reasons.
Hooks the internal LLM engine to emit spans with TTFT, queueing time, per-stage latency and sampling parameters.
Hijacks vLLM’s Prometheus loggers so that all engine metrics are pushed through OpenTelemetry meters instead of relying on pull-based scraping.
Usage
from opentelemetry.instrumentation.vllm import VLLMInstrumentor
VLLMInstrumentor().instrument()References
1 maintainer
Metadata
1 maintainer
Release files for tapm-instrumentation-vllm 0.1b3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| tapm_instrumentation_vllm-0.1b3.tar.gz | 25.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| tapm_instrumentation_vllm-0.1b3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 54.7 kB
Release files / tapm_instrumentation_vllm-0.1b3.tar.gz
| Download URL | tapm_instrumentation_vllm-0.1b3.tar.gz |
|---|---|
| Size | 25.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
71ebd9db44f180a842851ec142aa7c0a642c3ca0c6bf6e81591c9aa83350cb7d
|
|
BLAKE2b-256 checksum How to use checksums |
10b2d50ece767017f7b952bd5a0e5da44519205fb234e3929e6caa55b4430e67
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.2
|
Release files / tapm_instrumentation_vllm-0.1b3-py3-none-any.whl
| Download URL | tapm_instrumentation_vllm-0.1b3-py3-none-any.whl |
|---|---|
| Size | 29.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8ef076f08f9fb2376c247dc7d026bddf88ad0914802cf7d02e3b625fc7395fe0
|
|
BLAKE2b-256 checksum How to use checksums |
9a46c575cfb78b503f3bee3d70cb4e7d176ca73463baeba9c8eb021dab455c62
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.2
|
