aks-shannon-entropy 0.1.0

Compute shannon entropy from LLM responses to detect hallucinations

Shannon Entropy

Compute Shannon entropy from LLM responses to detect hallucinations and measure uncertainty in natural language generation.

Installation

pip install aks-shannon-entropy

Features

• Shannon Entropy Computation: Calculate entropy from LLM response distributions
• Hallucination Detection: Identify unreliable or hallucinated model outputs
• Uncertainty Quantification: Measure model confidence and uncertainty
• LLM Integration: Works with HuggingFace transformers and other LLM frameworks

Usage

from shannon_entropy import compute_entropy

responses = ["response1", "response2", "response3"]
entropy = compute_entropy(responses)
print(f"Entropy: {entropy}")

Dependencies

See pyproject.toml for full dependencies.

License

MIT - See LICENSE file for details.