Official Python SDK for Lexbench platform API
Project description
lexbench-sdk (Python)
LexBench 平台官方 Python SDK。
安装
pip install lexbench-sdk
快速开始
from lexbench_sdk import LexbenchClient
client = LexbenchClient(
base_url="https://bench.lexmount.com",
token="your_api_token",
)
result = client.submit_eval_run(
{
"agentName": "browser-use",
"benchmarkName": "LexBench-Browser",
"mode": "first_n",
"count": 5,
"split": "L1",
}
)
print(result["runUuid"])
当前平台创建任务仅支持三种模式:
allfirst_nsample_n
其中 first_n / sample_n 必须传 count。
支持的 API
submit_eval_run(payload)get_eval_run(run_uuid)create_token(payload=None)list_tokens()revoke_token(token_id)start_login()poll_login(session_id, session_secret)
发布
当前仓库未内置 PyPI / TestPyPI 自动发布 workflow,建议在 packages/lexbench-python-sdk 目录手动执行:
uv build
python3.11 -m twine upload --repository testpypi dist/*
python3.11 -m twine upload dist/*
建议先发 TestPyPI 验证,再发正式 PyPI。
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lexbench_sdk-0.1.1.tar.gz
(7.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lexbench_sdk-0.1.1.tar.gz.
File metadata
- Download URL: lexbench_sdk-0.1.1.tar.gz
- Upload date:
- Size: 7.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2113ffc6e1f7d3caa875a7a9d3c46c945c9c49287f0c2d02ad1f1085946f37d6
|
|
| MD5 |
aed7c878fc1142382365d9a0c89809c2
|
|
| BLAKE2b-256 |
9dccf4fb09f1c63b0cac60f932fcc5590d20f586d5c64c9d316acdd1f4f48903
|
File details
Details for the file lexbench_sdk-0.1.1-py3-none-any.whl.
File metadata
- Download URL: lexbench_sdk-0.1.1-py3-none-any.whl
- Upload date:
- Size: 4.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
46a60badb04b79e6733adbb4641a62f4e2d007d88f35993591b4c0442515696e
|
|
| MD5 |
6773dd0013073646a8de7bc1c3944d19
|
|
| BLAKE2b-256 |
423bc2ff9dc1e5c50e0ee9e3b03fc16d435a2aca44eb0fec4d0feeaf158dfc17
|