Skip to main content

Official Python SDK for Lexbench platform API

Project description

lexbench-sdk (Python)

LexBench 平台官方 Python SDK。

安装

pip install lexbench-sdk

快速开始

from lexbench_sdk import LexbenchClient

client = LexbenchClient(
    base_url="https://bench.lexmount.com",
    token="your_api_token",
)

result = client.submit_eval_run(
    {
        "agentName": "browser-use",
        "benchmarkName": "LexBench-Browser",
        "mode": "first_n",
        "count": 5,
        "split": "L1",
    }
)
print(result["runUuid"])

当前平台创建任务仅支持三种模式:

  • all
  • first_n
  • sample_n

其中 first_n / sample_n 必须传 count

支持的 API

  • submit_eval_run(payload)
  • get_eval_run(run_uuid)
  • create_token(payload=None)
  • list_tokens()
  • revoke_token(token_id)
  • start_login()
  • poll_login(session_id, session_secret)

发布

当前仓库未内置 PyPI / TestPyPI 自动发布 workflow,建议在 packages/lexbench-python-sdk 目录手动执行:

uv build
python3.11 -m twine upload --repository testpypi dist/*
python3.11 -m twine upload dist/*

建议先发 TestPyPI 验证,再发正式 PyPI。

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lexbench_sdk-0.1.1.tar.gz (7.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lexbench_sdk-0.1.1-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file lexbench_sdk-0.1.1.tar.gz.

File metadata

  • Download URL: lexbench_sdk-0.1.1.tar.gz
  • Upload date:
  • Size: 7.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for lexbench_sdk-0.1.1.tar.gz
Algorithm Hash digest
SHA256 2113ffc6e1f7d3caa875a7a9d3c46c945c9c49287f0c2d02ad1f1085946f37d6
MD5 aed7c878fc1142382365d9a0c89809c2
BLAKE2b-256 9dccf4fb09f1c63b0cac60f932fcc5590d20f586d5c64c9d316acdd1f4f48903

See more details on using hashes here.

File details

Details for the file lexbench_sdk-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: lexbench_sdk-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for lexbench_sdk-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 46a60badb04b79e6733adbb4641a62f4e2d007d88f35993591b4c0442515696e
MD5 6773dd0013073646a8de7bc1c3944d19
BLAKE2b-256 423bc2ff9dc1e5c50e0ee9e3b03fc16d435a2aca44eb0fec4d0feeaf158dfc17

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page