ecp-runtime 0.2.9

The reference runtime for the Evaluation Context Protocol (ECP).

ECP Runtime

This is the reference implementation of the Evaluation Context Protocol (ECP) Runtime. It includes the CLI tool ecp for running agent evaluations.

Install

pip install "ecp-runtime==0.2.9"

The latest stable PyPI release is now 0.2.9 and matches the current GitHub release line.

Usage

Run an evaluation manifest:

ecp run --manifest .\examples\langchain_demo\manifest.yaml

You can also run via module entrypoint:

python -m ecp_runtime.cli run --manifest .\examples\langchain_demo\manifest.yaml

If your manifest includes llm_judge, set an API key and optional judge model:

$env:OPENAI_API_KEY="your_key_here"
$env:ECP_LLM_JUDGE_MODEL="gpt-4o-mini"

Links

• Documentation: https://evaluationcontextprotocol.io/
• Repository: https://github.com/evaluation-context-protocol/ecp
• Issues: https://github.com/evaluation-context-protocol/ecp/issues