Skip to main content

CLI for Claude Code marketplace health — routing evals, coverage checks, and semantic collision detection

Project description

claude-marketplace-evaluator

CLI for Claude Code marketplace health — routing evals, coverage checks, and semantic collision detection.

Install

pip install claude-marketplace-evaluator
# or with uv:
uv add claude-marketplace-evaluator

Usage

# Check routing eval coverage and pass rate
cme routing --plugins-dir plugins/ --coverage-threshold 100 --threshold 95

# Detect semantic skill overlap
cme overlap --plugins-dir plugins/ --output overlap-report.json

Environment Variables

Variable Description Required
ANTHROPIC_API_KEY Anthropic API key One of these
ANTHROPIC_AUTH_TOKEN Databricks AI Gateway token One of these
ANTHROPIC_BASE_URL Custom base URL (Databricks AI Gateway) If using Gateway
ANTHROPIC_MODEL Model override Optional

Development

uv sync
pre-commit install
make check   # lint + format + typecheck
make test    # pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

claude_marketplace_evaluator-0.1.1.tar.gz (90.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

claude_marketplace_evaluator-0.1.1-py3-none-any.whl (13.9 kB view details)

Uploaded Python 3

File details

Details for the file claude_marketplace_evaluator-0.1.1.tar.gz.

File metadata

File hashes

Hashes for claude_marketplace_evaluator-0.1.1.tar.gz
Algorithm Hash digest
SHA256 cdb286fc233c7d0465ca70c2492f73398a8a53715725e58555ae8b4cd1136288
MD5 eab7e6e38e85c65c1b9a8c6e28b9d4c9
BLAKE2b-256 bb8878224654a209cb13a3beb6684243b0f28acc3ab855ff2217e943b2c7ed01

See more details on using hashes here.

Provenance

The following attestation bundles were made for claude_marketplace_evaluator-0.1.1.tar.gz:

Publisher: release.yml on IceRhymers/claude-marketplace-evaluator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file claude_marketplace_evaluator-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for claude_marketplace_evaluator-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c4c60f7f20ca84e53833fb00a6f02fbb236193cd74b55310dda9e22f6b93319f
MD5 e48fd1c2b336d65178754ae829ed578f
BLAKE2b-256 30e3b5bd2cfbad10cc58600dbb5a88199ed050338f32d46d9e24e835132ccb2e

See more details on using hashes here.

Provenance

The following attestation bundles were made for claude_marketplace_evaluator-0.1.1-py3-none-any.whl:

Publisher: release.yml on IceRhymers/claude-marketplace-evaluator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page