Skip to main content

WebArena benchmark for BrowserGym

Project description

WebArena benchmark for BrowserGym

This package provides browsergym.webarena, which is an unofficial port of the WebArena benchmark for BrowserGym.

Note: the original WebArena codebase has been slightly adapted to ensure compatibility.

Setup

  1. Install the package
pip install browsergym-webarena
  1. Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
  1. Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
  1. Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

browsergym_webarena-0.3.6.dev0.tar.gz (6.8 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file browsergym_webarena-0.3.6.dev0.tar.gz.

File metadata

File hashes

Hashes for browsergym_webarena-0.3.6.dev0.tar.gz
Algorithm Hash digest
SHA256 920f723f894f7ea61077d94ec2d8b97abc87dab936857963f0eae5145c403fc9
MD5 5c1fb07e487098b96d9a776b6cf69de5
BLAKE2b-256 6430ac521afd9d78348e35f5a2dee1c85133024c24dd2ea7254d23e84ab26af7

See more details on using hashes here.

File details

Details for the file browsergym_webarena-0.3.6.dev0-py3-none-any.whl.

File metadata

File hashes

Hashes for browsergym_webarena-0.3.6.dev0-py3-none-any.whl
Algorithm Hash digest
SHA256 f0ec68ee62411cd760bb7da505c57dc58b8087ffd5d31dc71e058189dd5623c2
MD5 85cec0b100bdd9bfd4a6dcb7c73d7486
BLAKE2b-256 913f7770094a65e12fda28bddd2f28ec06a11b64d784609321ded49410395853

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page