Quick Inter Coder Agreement in Python
Project description
Quick Inter Coder Agreement in Python
quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex.
Quick Inter Coder Agreement in Python
Free software: MIT license
Documentation: https://quica.readthedocs.io.
Get Quick Agreement
from quica.measures.irr import *
from quica.dataset.dataset import IRRDataset
from quica.quica import Quica
coder_1 = [0, 1, 0, 1, 0, 1]
coder_3 = [0, 1, 0, 1, 0, 0]
disagreeing_coders = [coder_1, coder_3]
disagreeing_dataset = IRRDataset(disagreeing_coders)
quica = Quica()
print(quica.get_results(disagreeing_dataset))
print(quica.get_latex(disagreeing_dataset))
Out[4]:
score
names
krippendorff 0.685714
fleiss 0.666667
scotts 0.657143
cohen 0.666667
Features
from quica.measures.irr import *
from quica.dataset.dataset import IRRDataset
from quica.quica import Quica
coder_1 = [0, 1, 0, 1, 0, 1]
coder_2 = [0, 1, 0, 1, 0, 1]
coder_3 = [0, 1, 0, 1, 0, 0]
agreeing_coders = [coder_1, coder_2]
agreeing_dataset = IRRDataset(agreeing_coders)
disagreeing_coders = [coder_1, coder_3]
disagreeing_dataset = IRRDataset(disagreeing_coders)
kri = Krippendorff()
cohen = CohensK()
assert kri.compute_irr(agreeing_dataset) == 1
assert cohen.compute_irr(agreeing_dataset) == 1
assert cohen.compute_irr(disagreeing_dataset) < 1
assert cohen.compute_irr(disagreeing_dataset) < 1
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2020-11-05)
First release on PyPI.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
quica-0.1.0.tar.gz
(11.1 kB
view hashes)
Built Distribution
Close
Hashes for quica-0.1.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0ee146d53e7001196ae46969df49a777455941c81f099f1a4959dc7dcba9027d |
|
MD5 | c79f8db48ecde7c96887e963c3573329 |
|
BLAKE2b-256 | 61e30a46a3ed35d754d6d5aeac4f373c7c8705d04ead281b1bb12c34155f3873 |