fabricatio-judge 0.1.3.dev1

fabricatio-judge extends the Fabricatio ecosystem to provide advanced judgment capabilities for LLM-driven applications.

fabricatio-judge

A Python module for evidence-based decision making in LLM applications.

📦 Installation

This package is part of the fabricatio monorepo and can be installed as an optional dependency:

pip install fabricatio[judge]

Or install all components:

pip install fabricatio[full]

🔍 Overview

Provides the AdvancedJudge class for structured judgment tasks, using collected evidence to determine a final boolean verdict.

Key Features:

• Asynchronous judgment execution
• Evidence tracking (affirmative & denying)
• Integration with Fabricatio agent framework
• Extensible for custom logic

🧩 Usage

from fabricatio.capabilities import AdvancedJudge
from fabricatio.models import JudgeMent


class MyJudge(AdvancedJudge):
    pass  # Implement custom logic if needed


async def evaluate():
    judge = MyJudge()
    result: JudgeMent = await judge.evidently_judge("Is water wet?")
    print(f"Verdict: {result.final_judgement}")

📁 Structure

fabricatio-judge/
├── capabilities/     - Judgment logic (`AdvancedJudge`)
└── models/           - Judgment output model (`JudgeMent`)

📄 License

MIT – see LICENSE

GitHub: github.com/Whth/fabricatio