Skip to main content

Modern inter-annotator agreement metrics with bootstrap confidence intervals.

Project description

iaa-kit

iaa-kit is a pure-NumPy inter-annotator agreement library with Krippendorff alpha, Cohen kappa, weighted kappa, Fleiss kappa, Gwet AC1/AC2, bootstrap confidence intervals, missing-data handling, and synthetic-report generation.

Quickstart

python -m venv .venv
. .venv/bin/activate
pip install iaa-kit
python -c "from iaa_kit import krippendorff_alpha; print(krippendorff_alpha([[1,1,2],[2,2,2]], scale='ordinal'))"

What This Is Not

This is not a human-label vendor, benchmark, or source of real annotations. Examples are synthetic.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iaa_kit-0.1.1.tar.gz (6.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

iaa_kit-0.1.1-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file iaa_kit-0.1.1.tar.gz.

File metadata

  • Download URL: iaa_kit-0.1.1.tar.gz
  • Upload date:
  • Size: 6.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for iaa_kit-0.1.1.tar.gz
Algorithm Hash digest
SHA256 20b71c596fb4afbef98fb38c2db807d37ca3d6be547d625d7b78b58e0660e87b
MD5 1380f6e5d0084583b26646f8a5c83c60
BLAKE2b-256 ee75554c32bf670caa09a8dcd3728e1424e7abbf331a3b668784ea02c48ed2f0

See more details on using hashes here.

File details

Details for the file iaa_kit-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: iaa_kit-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 6.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for iaa_kit-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9869f3566e46b1fe49e7ec87358a374c8d7ffa94a9e453fe6924aa53d5cd1198
MD5 44fed9f07b6cb17814a53ab6c4e3d0f3
BLAKE2b-256 4cc133ee0d8a75f835d68f325d990b82f64b7d4f4718d7103d60e55756d5cdd3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page