olmoearth_inferenceX

olmoearth_inferenceX checks an Earth-observation map after inference: where it is likely wrong, how wrong it is, which part you can trust, and which of two maps is more accurate. It was built to check OlmoEarth's inference outputs. It reads only the per-class scores a model writes out, never runs the model and needs no torch, so it works as well on other models' maps and on published products that ship a confidence layer.

Documentation: https://olmoearth-inferencex.readthedocs.io/

Install

pip install "olmoearth-inferencex[geo]"    # Python 3.11 to 3.13; without [geo] it reads .npy only
oe-inferencex demo                          # a real Dynamic World tile; needs no data

Usage

Every command starts with oe-inferencex. The input is the model's per-class scores before the argmax, as a GeoTIFF or a .npy array of shape (C, H, W). plan says how many labels a question needs, decide turns a result into yes, no or undetermined, and --help lists each command's options. Quick start runs each one on a test map.

Limits: without labels it says where to look, not how wrong the map is. Ranking by confidence can weaken when a model moves to a new place or year, and errors that come from two legends drawing a class boundary differently cannot be told from the imagery or the model, so they need labels. A model run on inputs unlike its training data can be confident and wrong (--condition treats each input condition on its own). Every interval and certified zone assumes the labels are right, and labelling more and rerunning is a second test, except on a sequential sample.

Use from an agent

oe-inferencex mcp is a local MCP server; nothing is hosted. Add it to any MCP client as the command uvx --from "olmoearth-inferencex[geo,mcp]" oe-inferencex mcp, for example in Claude Code:

claude mcp add --scope user oe-inferencex -- uvx --from "olmoearth-inferencex[geo,mcp]" oe-inferencex mcp

Use a capable model: in a pilot, smaller models dropped the limits the tools state. To try it, write the demo tile into an empty folder, start the agent there and ask:

uvx --from olmoearth-inferencex oe-inferencex demo

Where should I look first in oe_inferencex_demo/sample_probabilities.npy? Use windows of 1 pixel, and grade the order against oe_inferencex_demo/sample_truth.npy.

Evidence

Tested on linear probes of sixteen encoders over the tasks of Ai2's embedding suite, on seven published land-cover products against six reference samples, and on two deployed OlmoEarth models. Within the data a model was trained for, its confidence ranks the map's errors well; after a move to a new place and year it ranked them below the preregistered bar, and most of its confident errors lay on one class boundary that the two legends draw differently. The technical report and the documentation give every result and its limits.

Development and license

Clone the repository, then uv sync and uv run pytest; the experiments also need uv sync --extra encoder --extra geo. Apache License 2.0 (LICENSE); cite with CITATION.cff; questions in GitHub issues.