Tool to check how metric deltas for machine translation reflect on system-level human accuracies.
Project description
MT-Thresholds
Local version of the online tool. Use either from the command-line:
# accuracy is 63.989%
mt-thresholds bleu 1.00
# ChrF needs 0.710 difference for the same accuracy as BLEU
mt-thresholds chrf 0.63989 --delta
Or it can be used from Python:
import mt_thresholds
mt_thresholds.accuracy(1.0, "bleu") # 0.63989
mt_thresholds.delta(0.63989, "chrf") # 0.665
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mt_thresholds-1.0.0.tar.gz
(3.0 kB
view hashes)
Built Distribution
Close
Hashes for mt_thresholds-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0c1ed126da8425463e9abafb92e1b6aef0a4f28afac512254e6a7a24c637002a |
|
MD5 | 6424c8c59014b99664a56efa2a8bbe1c |
|
BLAKE2b-256 | e30dcbdb8b78f539cf10d93e6fc07fa23ee246d6a2dd65f9bdfb55ffffae4037 |