Skip to main content

A model-agnostic framework for quantifying and correcting systematic biases in LLM-as-judge evaluation pipelines.

Project description

Judgelens

A model-agnostic framework for quantifying and correcting systematic biases in LLM-as-judge evaluation pipelines.

Install

pip install judgelens

Examples

Check out full working examples here:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

judgelens-0.1.0.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

judgelens-0.1.0-py3-none-any.whl (11.4 kB view details)

Uploaded Python 3

File details

Details for the file judgelens-0.1.0.tar.gz.

File metadata

  • Download URL: judgelens-0.1.0.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for judgelens-0.1.0.tar.gz
Algorithm Hash digest
SHA256 68a251cb5b94ac69488e471e1855625728f2336385dfff07feaf671da390bbf3
MD5 7f368ddd8152c9ec05c6dcd38c2b9088
BLAKE2b-256 58d9ef186a78b4e566eafde69e74477b7130cef2d2b6e86822528d47937a1347

See more details on using hashes here.

File details

Details for the file judgelens-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: judgelens-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 11.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for judgelens-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 57c382181f5ce9123d1138d0a99a1f2adea990226a0d12dd6f0a4c7ea0945897
MD5 5941eeb268cc88bbce6b0d22a04c5997
BLAKE2b-256 2720ae0086c0b45e9ab6daba9f421f25272d7eaccf482458866d52107f3b996a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page