Simple vLLM/OpenAI textgen benchmark with optional GPU telemetry
Reason this release was yanked:
Update atributes
Project description
ttcbench
Benchmark for OpenAI/vLLM /v1/chat/completions endpoints with optional local GPU telemetry.
Install
pip install ttcbench
# env (optional)
echo 'MODEL_BASE_URL=http://host:3000/v1' > .env
echo 'MODEL_API_KEY=' >> .env
echo 'DEFAULT_MODEL=Qwen2.5-72B-Instruct-GPTQ-Int4' >> .env
# run
ttcbench run --task textgen --steps 10 --batch 2 --seq-out 128 \
--base-url "http://host:3000/v1" --model "Qwen2.5-72B-Instruct-GPTQ-Int4"
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ttcbench-0.1.0.tar.gz
(7.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ttcbench-0.1.0.tar.gz.
File metadata
- Download URL: ttcbench-0.1.0.tar.gz
- Upload date:
- Size: 7.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
58d7fdff07f2e6fdecb6819f8943e5652178f89f327cc79293208867ef98198b
|
|
| MD5 |
11f25af5378a99b197159dd39d3bfd03
|
|
| BLAKE2b-256 |
5986a24a7f682a61d60bd5b205fec972a3a65cb88ca11e0a432039b13db07cb3
|
File details
Details for the file ttcbench-0.1.0-py3-none-any.whl.
File metadata
- Download URL: ttcbench-0.1.0-py3-none-any.whl
- Upload date:
- Size: 8.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
53cb340f7150cbcfb3f678ed40fd3bca40a49b651c5bffa32e6c01c9942b2e7d
|
|
| MD5 |
f0167e0a342f190b9acb7d28d8333e7b
|
|
| BLAKE2b-256 |
49c31d6f8dccb8135befff4d27c5b1eb28d580c23d38da64e469c784f26e705a
|
