mt-thresholds 0.0.1

Tool to check how metric deltas for machine translation reflect on system-level human accuracies.

MT-Thresholds

Local version of the online tool. Use either from the command-line:

# accuracy is 63.989%
mt-thresholds bleu 1.00

# ChrF needs 0.710 difference for the same accuracy as BLEU
mt-thresholds chrf 0.63989 --delta

Or it can be used from Python:

import mt_thresholds

mt_thresholds.accuracy(1.0, "bleu") # 0.63989
mt_thresholds.delta(0.63989, "chrf") # 0.665