Inferlab Integration for SGLang
Framework-specific planning and rendering for running SGLang servers through Inferlab. The consuming workspace supplies SGLang and its hardware runtime; this package supplies only the Inferlab integration boundary.
See the Inferlab repository for workspace authoring and supported topology documentation.
When profiling intent is enabled, the integration declares every single,
prefill, and decode model-serving replica as a capture target of the
effective mechanism. Managed collection opens the Nsight Systems range
through POST /start_profile with SGLang's CUDA_PROFILER activity and
closes it through POST /stop_profile; engine trace renders the
control-plane-assigned trace directory into SGLANG_TORCH_PROFILER_DIR and
controls the window through the same action pair with the GPU activity.
InferLab, not this package, owns the profiler lifecycle, capture plan, report
verification, cleanup, and records.
For direct single, setting enable_metrics = true enables SGLang's native
Prometheus endpoint and declares /metrics to InferLab. Without that effective
setting the integration advertises no server-metrics capability.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file inferlab_integration_sglang-0.8.0-py3-none-any.whl.
File metadata
- Download URL: inferlab_integration_sglang-0.8.0-py3-none-any.whl
- Upload date:
- Size: 13.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.14.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
60f3333021d60eed9076f2267b7222a63466c3d53c1339401ea8471b51b6b6cd
|
|
| MD5 |
658cf2751343c4b8cbefcfcd1036efad
|
|
| BLAKE2b-256 |
db6f74aa55e7702b8b04a640ba46aa87284e1085e803bd6e370c7538b91f5563
|
