A framework for load testing llmbench APIs
Project description
LLMBench
A Tool for evaulation the performance of LLM APIs.
Installation
git clone ...
cd LLMBench
pip install -e .
Basic Usage
Example
llmbench_tokenmark \
--dataset "test1" \
--model test \ # 发起用那个客户端
--num_concurrent_requests 10 \
--timeout 600 \
--max_request_num 1000 \ # test1 数据集中 取1000条数据
--results-dir "result_outputs" \
--extra_params '{}'
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llmbench_cmri-0.1.1.tar.gz
(20.6 kB
view details)
Built Distribution
File details
Details for the file llmbench_cmri-0.1.1.tar.gz.
File metadata
- Download URL: llmbench_cmri-0.1.1.tar.gz
- Upload date:
- Size: 20.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b07719f8adf9b9b607d82ecf02ac4ae9dc73d911b88d525aefbb9be0b50afc9d |
|
| MD5 | 463bee5024697c270b26e8784d26f354 |
|
| BLAKE2b-256 | 1933ddca455548c245e27b374ce83c6497162984b2da35179fc460525eb4efb5 |
File details
Details for the file llmbench_cmri-0.1.1-py3-none-any.whl.
File metadata
- Download URL: llmbench_cmri-0.1.1-py3-none-any.whl
- Upload date:
- Size: 26.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b3652beaa7c26af223b37951fced7d78b9de1b69508050fe067b2fe8f8ce3f11 |
|
| MD5 | 208f8a09543ebf22f5922632c1fe3fb2 |
|
| BLAKE2b-256 | b0f954e68f8930d14ee1c3fb4f948d37b574575c0d2715814f716a0e5d53477f |
