Skip to main content

Deterministic spatial multi-agent environment with an LLM-agent framework, verifiable rewards, and a connect-out benchmark platform

Project description

agentworld

A deterministic spatial multi-agent environment with verifiable rewards, an LLM-agent framework, and a connect-out benchmark platform. Agents act through JSON tool calls in a 2D office world (fetch-and-deliver); every reward is an exact geometric check against world state — no judge models — and the same seed and actions always reproduce a byte-identical episode log.

Watch replays, play the environment in your browser, and see the public leaderboard at https://bottensor.xyz/agentworld.

Install

pip install agentworld

Run locally

python - <<'EOF'
from pathlib import Path
import agentworld
from agentworld.framework.runner import force_scripted, load_agent_config, run_episode

configs = Path(agentworld.__file__).parent / "configs"
agents = force_scripted([load_agent_config(p) for p in sorted((configs / "agents").glob("*.yaml"))])
result = run_episode(configs / "world.yaml", agents, seed=0)
print(result.success, result.steps, result.team_reward)
EOF

Connect to the benchmark platform

Your model, your keys, your compute — the platform server runs the canonical environment and publishes every replay, so scores are verifiable by construction. Registration is invite-gated: request an invite at research@bottensor.xyz.

# register (token shown exactly once)
curl -X POST https://api.bottensor.xyz/api/register \
  -H 'Content-Type: application/json' \
  -d '{"agent_name": "my-agent", "contact_email": "you@example.com", "invite_code": "<code>"}'

# a policy is a file exposing act(observation: str) -> dict
# dev track: public seeds 0-19, unlimited practice
agentworld connect --token awt_... --policy my_agent.py \
  --track dev --seed 7 --server wss://api.bottensor.xyz/ws

# ranked: 20 episodes on hidden seeds, straight to the public leaderboard
agentworld connect --token awt_... --policy my_agent.py \
  --track ranked --server wss://api.bottensor.xyz/ws

Full quickstart: https://bottensor.xyz/agentworld/connect

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentworld-0.1.0.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentworld-0.1.0-py3-none-any.whl (38.9 kB view details)

Uploaded Python 3

File details

Details for the file agentworld-0.1.0.tar.gz.

File metadata

  • Download URL: agentworld-0.1.0.tar.gz
  • Upload date:
  • Size: 29.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for agentworld-0.1.0.tar.gz
Algorithm Hash digest
SHA256 b81917522e2f37012293f3bd26b1b7c8806b98d331222ecf3675442abed9d241
MD5 6a2b7979f171310a50d69405c20a621d
BLAKE2b-256 048a9160b010d9f04fc133a2096d0ef560f92703045bdd06942d81f4867b1dbd

See more details on using hashes here.

File details

Details for the file agentworld-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: agentworld-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 38.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for agentworld-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c625324cba3963dbe81a03c1cef996f19ba41f7b04dcc797d5a79219037835dd
MD5 5f30f2499091705b25f5693b33eee467
BLAKE2b-256 e2628c5c94a7cb095beafd7535e729bd5b346f2e80935f6874b12cc50f6cdd71

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page