ecp-runtime 0.2.9b0

The reference runtime for the Evaluation Context Protocol (ECP).

ECP Runtime

This is the reference implementation of the Evaluation Context Protocol (ECP) Runtime. It includes the CLI tool ecp for running agent evaluations.

Install

pip install ecp-runtime

Usage

Run an evaluation manifest:

ecp run --manifest .\examples\langchain_demo\manifest.yaml

You can also run via module entrypoint:

python -m ecp_runtime.cli run --manifest .\examples\langchain_demo\manifest.yaml

If your manifest includes llm_judge, set an API key and optional judge model:

$env:OPENAI_API_KEY="your_key_here"
$env:ECP_LLM_JUDGE_MODEL="gpt-4o-mini"

Links

• Documentation: https://evaluationcontextprotocol.io/
• Repository: https://github.com/evaluation-context-protocol/ecp
• Issues: https://github.com/evaluation-context-protocol/ecp/issues