xpyd-bench 0.2.0

Benchmarking & PD ratio planning tool for xPyD proxy

📖 完整使用指南 → docs/guide.md

xPyD-bench

Benchmarking & PD ratio planning tool for xPyD-proxy.

Features

• xpyd-bench — Benchmark xPyD proxy with configurable concurrency, request patterns, and both /v1/completions and /v1/chat/completions endpoints

For PD ratio planning, see xPyD-plan.

Install

pip install xpyd-bench

Quick Start

Benchmark

# Run benchmark against a running xPyD proxy
xpyd-bench --target http://localhost:8080 \
           --endpoint chat \
           --concurrency 16 \
           --num-requests 200 \
           --output results.json

# Use completion endpoint
xpyd-bench --target http://localhost:8080 \
           --endpoint completion \
           --concurrency 8 \
           --num-requests 100

Configuration

See examples/ for sample configs and scenarios.

Output Metrics

• TTFT — Time to first token
• TPS — Tokens per second (per request & aggregate)
• Latency — P50 / P90 / P99 end-to-end latency
• Throughput — Total requests/sec and tokens/sec
• Error rate — Failed requests count and percentage

License

TBD