BenchScope
English | 简体中文
BenchScope is an open‑source LLM inference benchmarking platform built with Vibe Coding Harness Coding.
A visualization testing platform for LLM model performance & accuracy, supporting models inference with vLLM / SGLang and any OpenAI‑compatible API.
Features
- Easy to install —
pip installand one command starts the whole web platform. - Performance testing dual mode — Concurrency Mode (multi-level concurrency load) and Threshold Mode (auto-search the max concurrency meeting the threshold).
- Accuracy testing dual mode — Native（local model weights）/ Serving（API）double model tasks。
- Real-time data feedback — every concurrency result streams into tables, charts and progress in real time.
- Visualization curves — multi-dimensional charts for throughput / TTFT / TPOT / ITL.
- Log cache & download — run logs, mean/P99 summaries and Excel export with online preview & download.
Quick Start
# Install from PyPI
pip install benchscope
# Start
benchscope
# Options
benchscope --port 8080 --no-browser
Development
See docs/Readme.md.
Open Source
- License — Apache License 2.0
- Published on — PyPI: benchscope
- Source — https://github.com/LABELNET/benchscope
- Contributing — Feel free to open issues / pull requests on the source repository.
1 maintainer
Metadata
1 maintainer
Release files for benchscope 1.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| benchscope-1.1.1.tar.gz | 2.9 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| benchscope-1.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 5.9 MB
Release files / benchscope-1.1.1.tar.gz
| Download URL | benchscope-1.1.1.tar.gz |
|---|---|
| Size | 2.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f03d3621510078db030caf09b1449150d315ed86ecf9874fa4d113f931c773d2
|
|
BLAKE2b-256 checksum How to use checksums |
3999d14c9e3381cc0708b4584d38b63bea0f16c50987710c24bb7d023a0f0b0a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
Release files / benchscope-1.1.1-py3-none-any.whl
| Download URL | benchscope-1.1.1-py3-none-any.whl |
|---|---|
| Size | 3.0 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7a5f5bc3fc7cd4823557d96350c528a04d8efe91d2ebc9326ee77b45b5139fc0
|
|
BLAKE2b-256 checksum How to use checksums |
dac5c72de04b9ff93c66e27090d9a68551861d157775d80213e588c2d35515e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.11
|
