swecc-mesocosm 0.2.2

CLI and Python client for SWECC BenchAnything / Mesocosm (mesocosm + bench commands).

swecc-mesocosm

CLI and Python client for SWECC's BenchAnything / Mesocosm platform.

pip install swecc-mesocosm
mesocosm --help

One package, one command (mesocosm). There is no separate bench binary or swecc-bench on PyPI.

Env author quick start

mkdir my-env && cd my-env
mesocosm init

ollama pull llama3.2
python adapter.py          # terminal 1
mesocosm run local         # terminal 2 — Ollama + benchanything.json, no submit

When ready for the platform: mesocosm auth login → mesocosm env submit → mesocosm run create. See LOCAL_DEV.md in your repo after mesocosm init.

Command overview

Area	Examples
Local env / Ollama	mesocosm init, mesocosm run local
Auth & teams	mesocosm auth login, mesocosm team create
Submit repo	mesocosm env submit --github-url …
Platform runs	mesocosm run create, mesocosm run export RUN_ID
Domain helpers	mesocosm suggest, mesocosm validate, mesocosm register
Bench-api eval	mesocosm doctor, mesocosm eval test, mesocosm run get

See PACKAGING.md in this directory for how bench_common is bundled and how mesocosm run routes local vs platform subcommands.

Install (dev)

pip install -e ./packages/swecc-mesocosm

Configure

export MESOCOSM_BASE_URL=https://api.swecc.org/bench   # production
mesocosm doctor

Default: http://127.0.0.1:8010 (docker compose). See infra/mesocosm.env.example in the monorepo.

Python client

import asyncio
from swecc_mesocosm import BenchClient

async def main():
    c = BenchClient(base_url="http://127.0.0.1:8010")
    try:
        domains = await c.list_domains(published_only=True)
        print(len(domains), "published")
    finally:
        await c.aclose()

asyncio.run(main())