AssistantBench <> BrowserGym
This package provides an implementation for using the AssistantBench benchmark in BrowserGym.
Because AssistantBench includes open-ended tasks, setup is extremely easy and simply requires installing the package.
Please note that AssistantBench has a hidden test set, so test set predictions will need to be uploaded to the official leaderboard.
Setting up
- Install the package (this is still a wip)
pip install browsergym-assistantbench
- Run inference, e.g., run the following commands for demo on a simple toy task
python demo_agent/run_demo.py --task_name assistantbench.validation.3
- Test set predictions will be saved to
./assistantbench-predictions-test.jsonl. To evaluate on the official test set, upload these predictions to the official leaderboard.
1 maintainer
Metadata
1 maintainer
Release files for browsergym-assistantbench 0.14.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| browsergym_assistantbench-0.14.3.tar.gz | 9.0 kB | With provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| browsergym_assistantbench-0.14.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 20.2 kB
Release files / browsergym_assistantbench-0.14.3.tar.gz
| Download URL | browsergym_assistantbench-0.14.3.tar.gz |
|---|---|
| Size | 9.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9c28cfc7148105364a14a2fb4dd2effcb061adca644fca9d238a04b9f535353b
|
|
BLAKE2b-256 checksum How to use checksums |
2eb6a60e7d9cee4aea3f971b1e76bbb040a8d1acfcd7dcf8b8e69beebcb71914
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Jan 20, 2026.
Transparency logRelease files / browsergym_assistantbench-0.14.3-py3-none-any.whl
| Download URL | browsergym_assistantbench-0.14.3-py3-none-any.whl |
|---|---|
| Size | 11.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3d489b39eb7889ec0cfc7a8c0c097c549fc4e4b6bf7ca4df256a91c8d6e25713
|
|
BLAKE2b-256 checksum How to use checksums |
c40709199cc82b62562aea118bbbfc2ed8a2a023ee79fc2b0f93d747ed86bfb8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Jan 20, 2026.
Transparency logSecurity for browsergym-assistantbench 0.14.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for browsergym_assistantbench-0.14.3.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Jan 20, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
