benchscope
English | 简体中文
A visualization testing platform for LLM model performance & accuracy, supporting models deployed with vLLM / SGLang and any OpenAI-compatible inference service.
Features
- Easy to install —
pip installand one command starts the whole web platform. - Performance testing dual mode — Concurrency Mode (multi-level concurrency load) and Threshold Mode (auto-search the max concurrency meeting the threshold).
- Accuracy testing dual mode — Online / offline testing (planned, v5.0).
- Real-time data feedback — every concurrency result streams into tables, charts and progress in real time.
- Visualization curves — multi-dimensional charts for throughput / TTFT / TPOT / ITL.
- Log cache & download — run logs, mean/P99 summaries and Excel export with online preview & download.
Quick Start
# Install from PyPI
pip install benchscope
# Start
benchscope
# Options
benchscope --port 8080 --no-browser
Open Source
- License — Apache License 2.0
- Published on — PyPI: benchscope
- Source — https://github.com/LABELNET/benchscope
- Contributing — Feel free to open issues / pull requests on the source repository.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
benchscope-1.0.5.tar.gz
(1.7 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file benchscope-1.0.5.tar.gz.
File metadata
- Download URL: benchscope-1.0.5.tar.gz
- Upload date:
- Size: 1.7 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
be3c6421ba0e8074003307eb42842736695ae7c2b489c816a2ad9157e05873c3
|
|
| MD5 |
4c70a4a3d806c31ac32b461e4c08f354
|
|
| BLAKE2b-256 |
a28cca3325add661a77ef50389cd9988015e61cb43dc18b4266b64b8b52e31dd
|
File details
Details for the file benchscope-1.0.5-py3-none-any.whl.
File metadata
- Download URL: benchscope-1.0.5-py3-none-any.whl
- Upload date:
- Size: 1.7 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b09b29f68cf0e3afc3383437a4e813005b6129185c07f37c04bc12e34f6fa35f
|
|
| MD5 |
d831579872e0ec2cc4ffd7751d29750b
|
|
| BLAKE2b-256 |
f0863ab61e63d77a0ad8e406bc76b5a4a9d693a20b17bb76b9fbdb9f5b95a4f4
|
