Skip to main content

plantcv-mcp

Plant phenotyping over MCP — traits, plus the segmentation overlay they were measured from.

ci PyPI python license Glama DOI

PlantCV as an MCP measurement instrument: it returns plant trait numbers and the picture they were computed from, and refuses to return numbers when the segmentation is degenerate.

Unofficial. Not affiliated with, endorsed by, or sponsored by the Donald Danforth Plant Science Center or the PlantCV maintainers. See NOTICE.

Why you are handed the overlay

Both images below come from the same file and the same threshold method — the only difference is one parameter.

✅ channel="a", object_type="dark" ❌ channel="s", object_type="dark"
correct segmentation inverted segmentation
Mask covers 3.1% of the frame, 9 components. area=32427 Mask covers 96.1% — it is the background. area=1007829

The failure on the right is what this server exists to prevent. Without the picture, both runs return seventeen traits with correct units and entirely believable magnitudes. The one on the right is measuring the wall behind the plants.

Red marks the pixels that were measured; a cyan line traces the mask's own boundary, drawn on the mask's edge pixels so it never touches anything unmasked (the tint alone was invisible on a photo of red beans).

segment() returns the overlay and diagnostics but no traits. measure() requires the session_id that segment() mints, so a single-image measurement cannot be made without first being handed the image it came from. Batch mode is the exception: measure_images() applies one recipe to up to 200 images and returns no overlays. You are meant to settle that recipe on one image's overlay first, but the server does not check that you did. What it does check is that every image passes the same guards as segment(); an image that trips a blocking guard comes back with no traits.

That is not a style preference. Measured with PlantCV 4.11.3 on a synthetic render (the first row: tests/fixtures/multi_specimen.png) and on photographs:

failure what you get without the overlay
four-view render, whole-image ROI 17 plausible traits describing four merged plants
plant clipped by the frame size traits that are silently lower bounds
empty mask 17 traits of zeros, with PlantCV reporting in_bounds=True

All three produce entirely believable numbers with correct units.

Install

No install is needed if the host has uv: uvx plantcv-mcp fetches the current release into its own environment and runs it. Otherwise:

pip install plantcv-mcp

segment_leaves_sam() is the one optional tool: pip install "plantcv-mcp[sam]" adds torch, torchvision and segment-anything. Without the extra every other tool works and that one refuses with that command.

Requires Python 3.11+. Installing pulls PlantCV and its scientific stack, so the first install (or first uvx run) is not fast. From a checkout: uv add /path/to/plantcv-mcp.

Configure your MCP client

claude mcp add plantcv -- uvx plantcv-mcp

Claude Desktop and other stdio hosts:

{ "mcpServers": { "plantcv": { "command": "uvx", "args": ["plantcv-mcp"] } } }

With a pip install, use "command": "plantcv-mcp" (and drop uvx from the claude mcp add line); from a checkout, "command": "uv", "args": ["run", "--directory", "/path/to/plantcv-mcp", "plantcv-mcp"]. Verify with list_methods().

Flags: --root DIR (repeatable, or PLANTCV_MCP_ROOTS) confines every read, and every file the server keeps (see Security), to your imagery: plantcv-mcp --root /data/phenotyping. --no-isolate (or PLANTCV_MCP_ISOLATE=0) runs analyses in-process instead of in the crash-containing worker.

Tools

tool returns
suggest_segmentation(image_path, channel, method) contact sheets, and what each object_type would yield
segment(image_path, channel, method, ...) overlay + diagnostics + warnings — no traits
refine(session_id, ops) a NEW session with a cleaned-up mask, plus its overlay
measure(session_id, analyses, px_per_mm, ...) traits, or a raised error on a degenerate mask
calibrate_scale_from_marker(image_path, x, y, w, h, marker_length_mm) px_per_mm from a marker of known real size
correct_lens_distortion(image_path, checkerboard_dir, ...) a fisheye/wide-angle image undistorted via checkerboard calibration, written next to the input or to output_path
measure_regions(session_id, nrows, ncols, ...) one row per plant in a tray (RGB traits, thermal temperatures or HSI index stats), plus the numbered overlay
measure_morphology(session_id, prune_size, tangent_size, ...) leaf/stem skeleton traits + the numbered-segment overlay
count_leaves(session_id, min_distance, px_per_mm) leaf instances by watershed: an estimated count, per-instance area/centroid/bbox + the numbered overlay
segment_leaves_sam(session_id, checkpoint_path, device, ...) the same count from Segment Anything. Optional: needs the sam extra and a 375 MB checkpoint; CPU by default
measure_images(image_paths, channel, method, ...) one recipe across many images (per plant with a grid); traits only where valid; time-budgeted
segment_hyperspectral(envi_path, index, threshold, ...) an HSI session from a spectral-index threshold + pseudo-RGB overlay
measure_spectral(session_id, indices, ...) index statistics (and, opt-in, per-band reflectance)
segment_thermal(path, min_c, max_c, ...) a thermal session from a °C band + grey-frame overlay
measure_thermal(session_id, ...) max/min/mean/median °C under the mask
list_methods() channels, methods, object types, pinned PlantCV version

Typical loop: suggest_segmentation → segment → look at the overlay → segment again with a different channel, method or polarity if it is wrong (or refine if it is nearly right) → measure. Pass color_correct=true to segment when a ColorChecker is in the frame: colours are corrected to the reference before segmenting and measuring, and the card itself is excluded from the mask (exclude_color_card=true does only the exclusion).

The call that produced the left-hand image above:

{
  "image_path": "multi_specimen.png",
  "channel": "a",
  "method": "otsu",
  "object_type": "dark"
}

Its response — verbatim, apart from a shortened session_id and an elided message — with the overlay arriving beside it as an image:

{
  "session_id": "9d2384c8-…",
  "channel": "a",
  "method": "otsu",
  "object_type": "dark",
  "fill_size": 200,
  "color_correct": false,
  "mask_fraction": 0.031,
  "component_count": 9,
  "major_object_count": 4,
  "largest_area": 8628,
  "overlay_scale": 1.0,
  "overlay_png_bytes": 748233,
  "warnings": [
    {
      "code": "multi_specimen",
      "message": "4 comparably-sized objects detected (areas: [8628, 7981, 7106, 6748]). …"
    }
  ]
}

What it refuses, and why

Each guard below was added after a specific failure, and each names the next action. Several of those failures were first seen on photographs that are not distributed with this repository (the sorghum photo below is one); the tests reproduce them on synthetic images and the committed fixtures. Blocking guards withhold numbers; advisories travel with them.

  • Inverted mask (implausible_coverage) — the right-hand image above: 96% of the frame selected, seventeen believable traits, all describing the wall.
  • Nothing selected, or fill_size deleted the specimen (empty_mask, fill_erased_mask) — PlantCV returns seventeen zeros with in_bounds=True.
  • Background texture (noisy_segmentation) — a sorghum photo (not distributed; the tests use a synthetic stand-in) measured as one 650,000-px plant made of 118 chamber-wall specks.
  • Several plants in one mask (multi_specimen) — the number describes the group; use measure_regions(), which measures each plant and numbers the overlay.
  • Wrong scale, wrong kind, changed file — a marker measured 4.35× wrong by PlantCV's own ROI method; a thermal session handed to an RGB measurer; an image edited after segmentation. Each is refused naming the right tool.
  • A lens calibration the boards do not determine — a set whose focal length the fit leaves undetermined is refused naming the number, and one that determines it only loosely is accepted with the looseness said. That judgement is made per view, because the fit's uncertainty falls as frames are added whether or not the geometry improves: re-saving the same photographs, or shooting more of the same angle, buys nothing. A frame that fits far worse than the rest, or that moves the answer far more than the others allow, is dropped by name and the camera refitted.
  • No colour card when one was asked for — color_correct=true raises rather than returning colour traits that look corrected and are not.

Every warning code, every tool's parameters, and the measured facts behind each guard: docs/GUIDE.md — segmenting · traits and units · real-world units · lens correction · polarity · refining · colour correction · trays · morphology · leaf instances · leaf instances with Segment Anything · batches · hyperspectral and thermal · warning reference.

Security

This server reads image files the host user can read and returns them to the model as images; with no --root there is no allow-list. It writes:

  • the corrected image from correct_lens_distortion, next to its input (replacing an earlier run's output of the same name) or at an output_path that must not exist yet — under the same roots, never through a symlink;
  • the Segment Anything checkpoint (375 MB), only when segment_leaves_sam is called with download_checkpoint=true, into $XDG_CACHE_HOME/plantcv-mcp (default ~/.cache/plantcv-mcp; PLANTCV_MCP_SAM_CACHE moves it), which must lie under a root when roots are set;
  • short-lived private copies of hyperspectral (ENVI) and FLIR thermal inputs in the system temporary directory, deleted once the file is decoded.

Run it as a user whose read access you are comfortable exposing, set --root, and do not run it as root. PlantCV/OpenCV analyses run in a worker subprocess, so a native crash is a tool error, not a dead server. Details: security · read roots · crash containment · limitations.

Attribution and licensing

This project is MIT licensed. It depends on PlantCV, which is licensed under the Mozilla Public License 2.0. No PlantCV source is vendored or redistributed here — it is an ordinary runtime dependency — so the MIT license applies to this project's own files. See NOTICE for the full statement.

More

Images on this page are rendered from tests/fixtures/multi_specimen.png, an original render by the author, and regenerate from committed code.

Release files for plantcv-mcp 1.16.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for plantcv-mcp 1.16.1
File Size Uploaded
plantcv_mcp-1.16.1.tar.gz 3.5 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for plantcv-mcp 1.16.1
File Interpreter ABI Platform
plantcv_mcp-1.16.1-py3-none-any.whl Python 3 none any Details

Total release size: 3.6 MB

Release files / plantcv_mcp-1.16.1.tar.gz

Download URL plantcv_mcp-1.16.1.tar.gz
Size 3.5 MB
Tags Source
SHA-256 checksum
How to use checksums
8b01681bf390740291df19123ee2c2b7ae8e95860692515ebdc00a827fcfa2cb
BLAKE2b-256 checksum
How to use checksums
9a87f3c949f0cea91c65d9758b0eb36a9a96fb5cda9906479578322746167d45
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.2

Release files / plantcv_mcp-1.16.1-py3-none-any.whl

Download URL plantcv_mcp-1.16.1-py3-none-any.whl
Size 149.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
aa7b10afec36c80c8b75ad8029b1c1fbd8b60b455ecf0b523348c68eb17f7364
BLAKE2b-256 checksum
How to use checksums
259e56e3e199236be2aa72417b20b77e2e21a9c7bb743e831d11d2514dbd0f67
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.2

Release history Release notifications | RSS feed

This release

1.16.1 This release

2 release files

1.16.0

2 release files

1.15.0

2 release files

1.14.0

2 release files

1.9.0

2 release files

1.8.2

2 release files

1.8.1

2 release files

1.8.0

2 release files

1.7.0

2 release files

1.6.0

2 release files

1.5.5

1 release file

1.5.4

2 release files

1.5.3

2 release files

1.5.2

2 release files

1.5.1

2 release files

1.5.0

2 release files

1.4.0

2 release files

1.3.1

2 release files

1.3.0

2 release files

1.2.1

2 release files

1.2.0

1 release file

1.1.0

2 release files

1.0.1

2 release files

1.0.0

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.1

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page