Tool to check how metric deltas for machine translation reflect on system-level human accuracies.
Project description
MT-Thresholds
Local version of the online tool. Use either from the command-line:
# accuracy is 63.989%
mt-thresholds bleu 1.00
# ChrF needs 0.710 difference for the same accuracy as BLEU
mt-thresholds chrf 0.63989 --delta
Or it can be used from Python:
import mt_thresholds
mt_thresholds.accuracy(1.0, "bleu") # 0.63989
mt_thresholds.delta(0.63989, "chrf") # 0.665
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mt-thresholds-0.0.2.tar.gz
(2.5 kB
view hashes)
Built Distribution
Close
Hashes for mt_thresholds-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a777af2f9703c401a38facb357c83df0ab5f24505bcfe99c67e3b4c55d7722dd |
|
MD5 | 1eca9fca6d3fc70f5b37a86d2f0b24bb |
|
BLAKE2b-256 | 32b4fb5211345cb7a4163f6aeddb532f7089c30f4c7fbd7f11387b73e577303e |