BenchScope
English | 简体中文
BenchScope is an open‑source LLM inference benchmarking platform built with Vibe Coding Harness Coding.
A visualization testing platform for LLM model performance & accuracy, supporting models inference with vLLM / SGLang and any OpenAI‑compatible API.
Features
- Easy to install —
pip installand one command starts the whole web platform. - Performance testing dual mode — Concurrency Mode (multi-level concurrency load) and Threshold Mode (auto-search the max concurrency meeting the threshold).
- Accuracy testing dual mode — Native（local model weights）/ Serving（API）double model tasks。
- Real-time data feedback — every concurrency result streams into tables, charts and progress in real time.
- Visualization curves — multi-dimensional charts for throughput / TTFT / TPOT / ITL.
- Log cache & download — run logs, mean/P99 summaries and Excel export with online preview & download.
Quick Start
# Install from PyPI
pip install benchscope
# Start
benchscope
# Options
benchscope --port 8080 --no-browser
Development
See docs/Readme.md.
Open Source
- License — Apache License 2.0
- Published on — PyPI: benchscope
- Source — https://github.com/LABELNET/benchscope
- Contributing — Feel free to open issues / pull requests on the source repository.
1 maintainer
Metadata
1 maintainer
Release files for benchscope 1.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| benchscope-1.1.0.tar.gz | 2.9 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| benchscope-1.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 5.8 MB
Release files / benchscope-1.1.0.tar.gz
| Download URL | benchscope-1.1.0.tar.gz |
|---|---|
| Size | 2.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a2efbf80067af6246cff89c6ca333d32adbfc4da4763a167e7dece2634f14930
|
|
BLAKE2b-256 checksum How to use checksums |
39a9afb70de9095c7dfffbdf9413eef237dd617f06d7c0fcc0ed4f28db7a2c22
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
Release files / benchscope-1.1.0-py3-none-any.whl
| Download URL | benchscope-1.1.0-py3-none-any.whl |
|---|---|
| Size | 2.9 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
11e887de6a29dd0ee87ac65962600c5d55311c3f466d06c16d3352c6474f559f
|
|
BLAKE2b-256 checksum How to use checksums |
2d7404fa4f8ff6380565c2a76506e3557777b8ca4900bd3e35cdc8f615d217d0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
