BenchScope
English | 简体中文
BenchScope is an open‑source LLM inference benchmarking platform built with herness coding.
A visualization testing platform for LLM model performance & accuracy, supporting models deployed with vLLM / SGLang and any OpenAI-compatible inference service.
Features
- Easy to install —
pip installand one command starts the whole web platform. - Performance testing dual mode — Concurrency Mode (multi-level concurrency load) and Threshold Mode (auto-search the max concurrency meeting the threshold).
- Accuracy testing dual mode — Online / offline testing (planned, v5.0).
- Real-time data feedback — every concurrency result streams into tables, charts and progress in real time.
- Visualization curves — multi-dimensional charts for throughput / TTFT / TPOT / ITL.
- Log cache & download — run logs, mean/P99 summaries and Excel export with online preview & download.
Quick Start
# Install from PyPI
pip install benchscope
# Start
benchscope
# Options
benchscope --port 8080 --no-browser
Development
See docs/Readme.md.
Open Source
- License — Apache License 2.0
- Published on — PyPI: benchscope
- Source — https://github.com/LABELNET/benchscope
- Contributing — Feel free to open issues / pull requests on the source repository.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
benchscope-1.0.6.tar.gz
(2.7 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file benchscope-1.0.6.tar.gz.
File metadata
- Download URL: benchscope-1.0.6.tar.gz
- Upload date:
- Size: 2.7 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d472312aea384071f52076091852ed0d94647633a0172b63a9d170786bc524d3
|
|
| MD5 |
eaa9fe940961508a1ce868ccf37670bc
|
|
| BLAKE2b-256 |
23af869bb72ea79fdcbd20cf4aadcc4bfb81fa0f8a275dd3f8caf15be18f34fe
|
File details
Details for the file benchscope-1.0.6-py3-none-any.whl.
File metadata
- Download URL: benchscope-1.0.6-py3-none-any.whl
- Upload date:
- Size: 2.7 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fdaf47bbe9d201e715da505790e4dac56e8e1dc90297ef40b1c03ae6f85d4d44
|
|
| MD5 |
d5b0d0c5a0ee4ac05edaf481bd85b4f9
|
|
| BLAKE2b-256 |
aa83dcb188ab72aa71d98cff1af608f6ffa0e8dd8785659129f98ca27a9ce676
|
