Skip to main content

Universal AI validation SDK — hallucination, factuality, safety checks for any LLM output

Project description

ai-qa-sdk

Python SDK for validating AI outputs.

Installation

pip install ai-qa-sdk

Quick Start

from ai_qa import validate

# Validate AI output with built-in checks
result = validate(
    output="The capital of France is Paris",
    input="What is the capital of France?",
    checks=["factuality", "relevance"]
)

# Check results
print(f"Passed: {result.passed}")
print(f"Cost: ${result.total_cost:.4f}")

for check in result.checks:
    print(f"  {check.name}: {check.score:.2f}")

Documentation

See CLAUDE.md for development guide.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_qa_sdk-0.1.2.tar.gz (112.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_qa_sdk-0.1.2-py3-none-any.whl (70.4 kB view details)

Uploaded Python 3

File details

Details for the file ai_qa_sdk-0.1.2.tar.gz.

File metadata

  • Download URL: ai_qa_sdk-0.1.2.tar.gz
  • Upload date:
  • Size: 112.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.13

File hashes

Hashes for ai_qa_sdk-0.1.2.tar.gz
Algorithm Hash digest
SHA256 da3297fb305deac5380bfda9934583f10adc859af8a18c7460a2d73d321032ca
MD5 ad848012250b3f86a5d8e3e19bc4e41d
BLAKE2b-256 651c51f937c551c39410277f7b9715a7adae798d410696864500254587d9d60c

See more details on using hashes here.

File details

Details for the file ai_qa_sdk-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: ai_qa_sdk-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 70.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.13

File hashes

Hashes for ai_qa_sdk-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 34e36d9f42d678d0d411338ec037ec705b20de859a27520f963c391f0e380a41
MD5 49b4396ce27d99233e00f74efb2b26eb
BLAKE2b-256 8fb68bb3dd98d2163ffd4fcdd12a300a95f95b2f21096a66151f17ac1a6abd54

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page