roborank 0.1.0

Open RoboRank robotics challenge environment catalog.

RoboRank Envs

Open-source package for RoboRank robotics challenge environments.

This package exposes the RoboRank challenge catalog, policy-facing API, and simulation runners so environments can be validated and run outside the main RoboRank application.

Setup

uv sync
uv run roborank-envs validate
uv run roborank-envs list
ROBORANK_DISABLE_RERUN_EXPORT=1 uv run roborank-envs run diff_drive_reach_target --policy samples/policies/pure_pursuit.py

Public CLI

The PyPI distribution is published as roborank and installs both the public roborank CLI and the lower-level roborank-envs environment runner:

pip install roborank

The public CLI supports hosted RoboRank API workflows and local challenge evaluation:

uv run roborank prime --agent --json
uv run roborank eval list --json
uv run roborank eval run diff_drive_reach_target --policy-source samples/policies/pure_pursuit.py --out runs/local-001 --json
uv run roborank eval submit diff_drive_reach_target --policy-source robot_policy.py --yes --non-interactive --json

roborank eval run uses the packaged roborank_envs.runner local execution path. Install the visualization extra when you need upload-ready Rerun .rrd bundles:

uv sync --extra visualization

Use From RoboRank

From the RoboRank backend checkout:

uv sync
uv run python -m app.environment_registry
uv run pytest

The RoboRank backend pins this package by git commit in backend/pyproject.toml and reports the active package version and git SHA from /health and run metadata.

Current Scope

• .codex/skills/create-challenge/ contains the repo-local challenge authoring skill, including the brief template and authoring spec.
• src/roborank_envs/catalog.py exposes list_challenges() and get_challenge().
• src/roborank_envs/catalog_data.json is a snapshot of the current RoboRank challenge catalog.
• src/roborank_envs/simulation/ contains the environment runners, robot primitives, MuJoCo world builders, rendering helpers, and Rerun export path.
• src/roborank_envs/policy_api.py and policy_loader.py contain the public policy API and local policy loading helpers.
• src/roborank_envs/runner.py runs a local policy file against a packaged challenge.
• src/roborank/cli.py exposes the public RoboRank CLI, including resource, metrics, evidence, hosted eval submit, local eval run, migration, and launch operator commands.
• docs/challenges/ carries public-facing challenge docs.
• samples/policies/ carries sample policies used for parity checks.

Integration Status

The private RoboRank backend can execute submitted policies through this package. The duplicated internal runner code should stay in RoboRank until a canary deploy has proven the package path in production.

Authoring Challenges

Use .codex/skills/create-challenge/SKILL.md as the agent workflow for adding or modifying environments. It points to:

• .codex/skills/create-challenge/references/challenge-authoring-spec.md
• .codex/skills/create-challenge/assets/challenge-brief-template.md