3 projects
judgekeeper
Check your LLM-as-a-judge in 5 steps: Find. Mark. Measure. Fix. Re-check.
judgekeeper-mcp
Holds the name for judgekeeper MCP. It has no features; the first release will be 0.1.0.
pytest-judgekeeper
pytest plugin that fails a test when an LLM judge stops agreeing with human labels (installs judgekeeper).