Skip to main content

CLI for Claude Code marketplace health — routing evals, coverage checks, and semantic collision detection

Project description

claude-marketplace-evaluator

CLI for Claude Code marketplace health — routing evals, coverage checks, and semantic collision detection.

Install

pip install claude-marketplace-evaluator
# or with uv:
uv add claude-marketplace-evaluator

Usage

# Check routing eval coverage and pass rate
cme routing --plugins-dir plugins/ --coverage-threshold 100 --threshold 95

# Detect semantic skill overlap
cme overlap --plugins-dir plugins/ --output overlap-report.json

Environment Variables

Variable Description Required
ANTHROPIC_API_KEY Anthropic API key One of these
ANTHROPIC_AUTH_TOKEN Databricks AI Gateway token One of these
ANTHROPIC_BASE_URL Custom base URL (Databricks AI Gateway) If using Gateway
ANTHROPIC_MODEL Model override Optional

Development

uv sync
pre-commit install
make check   # lint + format + typecheck
make test    # pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

claude_marketplace_evaluator-0.1.0.tar.gz (90.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

claude_marketplace_evaluator-0.1.0-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file claude_marketplace_evaluator-0.1.0.tar.gz.

File metadata

File hashes

Hashes for claude_marketplace_evaluator-0.1.0.tar.gz
Algorithm Hash digest
SHA256 c0695b2b51899d1990f98888c13c23d5445632d5a9a901ef4c6adb4c09384d84
MD5 aedfe632c63401eb38bf35bdab685046
BLAKE2b-256 5ce01439a0b295c61fad93b8a553b439a7d18ef51b8ee0629eff6558f2ce54fb

See more details on using hashes here.

Provenance

The following attestation bundles were made for claude_marketplace_evaluator-0.1.0.tar.gz:

Publisher: release.yml on IceRhymers/claude-marketplace-evaluator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file claude_marketplace_evaluator-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for claude_marketplace_evaluator-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f3c10e22ded2709c3e503564a696eb6b003e8ea30749c0e79850bfd5ee8ab454
MD5 6d57a3865cd203d38310d774c0228e13
BLAKE2b-256 df0f38f8e30eabf69dcc4a937442d52f4c688d30b836abb0f912191c743c1ba3

See more details on using hashes here.

Provenance

The following attestation bundles were made for claude_marketplace_evaluator-0.1.0-py3-none-any.whl:

Publisher: release.yml on IceRhymers/claude-marketplace-evaluator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page