eval-hub-mcp

This package distributes the compiled Go eval-hub-mcp server binary for multiple platforms. It installs the binary directly into your bin/ directory (Scripts/ on Windows) with no Python wrapper — no argument rewriting, no subprocess overhead, no Python runtime required at execution time.

Installation

pip install eval-hub-mcp

Capabilities

With EVALHUB_BASE_URL, EVALHUB_TOKEN, and EVALHUB_TENANT configured, the server exposes MCP tools (discover_providers, submit_evaluation, get_job_status, cancel_job), resources (evalhub://providers, evalhub://benchmarks, evalhub://collections, evalhub://jobs, and more), and prompts (edd_workflow, evaluate_model, compare_runs). See MCP.md in the eval-hub repository for the full reference.

Usage

# Run in stdio mode (default, for IDE integration)
evalhub-mcp

# Run in HTTP mode
evalhub-mcp --transport http --port 3001

# Show version
evalhub-mcp --version

Supported Platforms

  • Linux: x86_64, arm64
  • macOS: x86_64 (Intel), arm64 (Apple Silicon)
  • Windows: x86_64

For eval-hub-sdk Users

Note: eval-hub-sdk[mcp] currently installs a Python FastMCP-based server. This will be replaced with eval-hub-mcp (the Go binary distributed by this package) in a future release.

If you're using eval-hub-sdk, you can install the MCP server as an extra:

pip install eval-hub-sdk[mcp]

For more information, see the eval-hub-sdk repository.

License

Apache-2.0

Project links

Data verified by PyPI on Aug 20, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for gnaulak from gravatar.com gnaulak Avatar for ruivieira from gravatar.com ruivieira

Credits

Author: Rui Vieira

GitHub Statistics

Data verified by PyPI on Aug 20, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.11

Tags

eval-hub mcp binary model-context-protocol

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

eval_hub_mcp-1.0.1-py3-none-win_amd64.whl (5.6 MB view details)

Uploaded Python 3Windows x86-64

eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_x86_64.whl (5.5 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_aarch64.whl (4.9 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

eval_hub_mcp-1.0.1-py3-none-macosx_11_0_arm64.whl (5.1 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

eval_hub_mcp-1.0.1-py3-none-macosx_10_9_x86_64.whl (5.6 MB view details)

Uploaded Python 3macOS 10.9+ x86-64

File details

Details for the file eval_hub_mcp-1.0.1-py3-none-win_amd64.whl.

File metadata

  • Download URL: eval_hub_mcp-1.0.1-py3-none-win_amd64.whl
  • Upload date:
  • Size: 5.6 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for eval_hub_mcp-1.0.1-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 dfa48e823782d797cddc8c78703abbe66c7392429a56d926bcfcc4cc111550ae
MD5 861ba48d5072de446e90367839cdfe09
BLAKE2b-256 32783472d7b483b9f24fdf7f99ff3283fda4a50c5b7641fe4bc1eb0ea216facc

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.1-py3-none-win_amd64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 1951750642b25f0b213ed20abdd3ab1746ac64f472b315d32471283d2790862b
MD5 8b391079b8c92b82fef87357602d76d0
BLAKE2b-256 79ecdd59edcb558fb231fd248a8a8c8d788b8a5f9fac7d4091b6cef5028bbe56

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_x86_64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_aarch64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 7c78c28d0478e95b022a5bee2548de642015de452ed1623071daf9cb6841e72f
MD5 ec381992967ee7fc59dd6a5624ee1cd4
BLAKE2b-256 679d73206704a423ff3a99987fb95e2f8a395144d2e2a867c8e594cc849e526e

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.1-py3-none-manylinux_2_17_aarch64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.1-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.1-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 7e86600802140978616403926a536dea8c04b49fa9176d7390aba825d7e754f5
MD5 bc36e548e760c2df72aece20935eadb8
BLAKE2b-256 47d6fc982e8632654672aa5a505ea30400a17dbd82db0e3b7ee9a47d87f049f7

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.1-py3-none-macosx_11_0_arm64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eval_hub_mcp-1.0.1-py3-none-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for eval_hub_mcp-1.0.1-py3-none-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 1119add5228e1422a080c72aad39d0b2425a46d21174b06e7adf5ab90f9e73ab
MD5 8a99f4cd96414f3080876957f250f646
BLAKE2b-256 d8f284fe776717b7a798467109e335a7013b69804ab4a83642858473cbfc4271

See more details on using hashes here.

Provenance

The following attestation bundles were made for eval_hub_mcp-1.0.1-py3-none-macosx_10_9_x86_64.whl:

Publisher: publish-python-mcp.yml on eval-hub/eval-hub

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

1.0.1 This release

5 files

1.0.0

5 files

0.4.4

5 files

Pre-release

0.4.4.dev54

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page