dr-wandb 3.0.0

Unified export toolkit for Weights & Biases

dr-wandb

Unified export tooling for Weights & Biases.

Installation

uv tool install dr-wandb

Or as a library:

uv add dr-wandb

Authentication

wandb login

CLI

There is one public command:

wandb-export ENTITY PROJECT --name EXPORT_NAME [OPTIONS]

Example metadata-only export:

wandb-export ml-moe moe --name moe_runs --data-root data

This writes:

data/moe_runs/
  manifest.json
  state.json
  runs.jsonl

Example history export:

wandb-export ml-moe moe \
  --name moe_history \
  --data-root data \
  --mode history

This writes:

data/moe_history/
  manifest.json
  state.json
  runs.jsonl
  history.jsonl

History export can be limited with selection flags:

wandb-export ml-moe moe \
  --name moe_eval_tail \
  --data-root data \
  --mode history \
  --history-key eval/loss \
  --history-key eval/accuracy \
  --max-records 100

Library Usage

from pathlib import Path

from dr_wandb import ExportEngine, ExportMode, ExportRequest

summary = ExportEngine(
    ExportRequest(
        entity="ml-moe",
        project="moe",
        name="moe_runs",
        data_root=Path("data"),
        mode=ExportMode.METADATA,
    )
).export()

print(summary.run_count)

Loaders

Read an existing export back in with the top-level helper functions:

from pathlib import Path

from dr_wandb import load_manifest, load_run_snapshots

manifest = load_manifest("moe_runs", Path("data"))
snapshots = load_run_snapshots("moe_runs", Path("data"))

print(manifest.mode, len(snapshots))

If the export includes history rows:

from pathlib import Path

from dr_wandb import iter_history_rows

rows = list(iter_history_rows("moe_history", Path("data")))
print(len(rows))

ExportStore is also available if you want direct access to the per-export directory layout and I/O.

Core Concepts

• ExportMode.METADATA exports current run snapshots only.
• ExportMode.HISTORY exports current run snapshots plus history rows.
• SyncMode.INCREMENTAL fetches newly created runs and refreshes tracked non-terminal runs.
• SyncMode.FULL_RECONCILE rebuilds the export from scratch.
• Each named export is self-contained inside data_root / name.

License

MIT