Skip to main content

eval-hub-mcp

This package distributes the compiled Go eval-hub-mcp server binary for multiple platforms. It installs the binary directly into your bin/ directory (Scripts/ on Windows) with no Python wrapper — no argument rewriting, no subprocess overhead, no Python runtime required at execution time.

Installation

pip install eval-hub-mcp

Capabilities

With EVALHUB_BASE_URL, EVALHUB_TOKEN, and EVALHUB_TENANT configured, the server exposes MCP tools (discover_providers, submit_evaluation, get_job_status, cancel_job), resources (evalhub://providers, evalhub://benchmarks, evalhub://collections, evalhub://jobs, and more), and prompts (edd_workflow, evaluate_model, compare_runs). See MCP.md in the eval-hub repository for the full reference.

Usage

# Run in stdio mode (default, for IDE integration)
evalhub-mcp

# Run in HTTP mode
evalhub-mcp --transport http --port 3001

# Show version
evalhub-mcp --version

Supported Platforms

  • Linux: x86_64, arm64
  • macOS: x86_64 (Intel), arm64 (Apple Silicon)
  • Windows: x86_64

For eval-hub-sdk Users

Note: eval-hub-sdk[mcp] currently installs a Python FastMCP-based server. This will be replaced with eval-hub-mcp (the Go binary distributed by this package) in a future release.

If you're using eval-hub-sdk, you can install the MCP server as an extra:

pip install eval-hub-sdk[mcp]

For more information, see the eval-hub-sdk repository.

License

Apache-2.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

eval_hub_mcp-1.0.0-py3-none-win_amd64.whl (5.6 MB view details)

Uploaded Python 3Windows x86-64

eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_x86_64.whl (5.5 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_aarch64.whl (4.9 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

eval_hub_mcp-1.0.0-py3-none-macosx_11_0_arm64.whl (5.1 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

eval_hub_mcp-1.0.0-py3-none-macosx_10_9_x86_64.whl (5.6 MB view details)

Uploaded Python 3macOS 10.9+ x86-64

File details

Details for the file eval_hub_mcp-1.0.0-py3-none-win_amd64.whl.

File metadata

  • Download URL: eval_hub_mcp-1.0.0-py3-none-win_amd64.whl
  • Upload date:
  • Size: 5.6 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for eval_hub_mcp-1.0.0-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 b7e987c6385e84ce7cea4833391cb329493f3f016367ae79825c171c0567ac68
MD5 de3192c6dfe7ea4593ef13b13f2e9b77
BLAKE2b-256 621d0cf34ea222916e7d55dee633b7c73e45de8e62c1398bfb4b0d3b638e64f9

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.0-py3-none-win_amd64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 9d35682302431f496ff68060a660bbe7107c50fa9e83bf0a7f0f5354d4dc0d0b
MD5 26144fa1724eaba8de41d7feedf615ba
BLAKE2b-256 ecd45b8ab705533d36515b060815447d79dcaf8b579fafb56c5c0f354a786434

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_x86_64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 95c1bca7529999bcc9e36ba7dab4fbf4fa106f0bd4aa74436a69f5af760c1848
MD5 77ff8f29628e144a35a0c391ee6f6e4d
BLAKE2b-256 22ebd45f58e00ba7c7465c373772a6cbbea1d89cd0eb5a7066c80a98b3606067

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.0-py3-none-manylinux_2_17_aarch64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.0-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.0-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ffe782f270b89d3f872ace716184ce702d45d9b697b9a6c521c92556d0bb3f21
MD5 1ee1b2819ca114c101a0b1895b6ca652
BLAKE2b-256 61fdf4aeed213e51a9da250bcfb106f6890e71a814defc69211389677cf3f4fb

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.0-py3-none-macosx_11_0_arm64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.0-py3-none-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.0-py3-none-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 10faefb31ccb64626ec69e67d8029c98d84d707b174e58bfe5b7c26a79329907
MD5 5176ab4ae118bfdddc03ecdb495d63bc
BLAKE2b-256 70a49a172f9352837edff4f37fe3c5000269ca27f04a52886ac1710bc2166f79

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.0-py3-none-macosx_10_9_x86_64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

1.0.1

5 files

This release

1.0.0 This release

5 files

0.4.4

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page