Machine-translation plugin for InferenceBench Suite (chrF/BLEU/exact-match on bundled fixtures)
Project description
inferencebench-mt
Machine-translation plugin for the InferenceBench Suite.
Scores model translations against bundled reference fixtures using chrF (character
n-gram F-score), token-level BLEU, or exact match. Mirrors the contract of the
other plugins (list_benchmarks / get_benchmark / validate / run) and
emits the canonical signed envelope.
Two bundled benchmarks ship out of the box:
llm.mt.flores-200-mini-en-fr— FLORES-200-style English to French, chrF.llm.mt.flores-200-mini-en-de— FLORES-200-style English to German, chrF.
The fixtures are tiny (eight rows each, mixed across greeting / news / technical / conversational domains) — intended for skeleton verification, not headline numbers.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file inferencebench_mt-0.0.2.tar.gz.
File metadata
- Download URL: inferencebench_mt-0.0.2.tar.gz
- Upload date:
- Size: 16.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.14 {"installer":{"name":"uv","version":"0.11.14","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cab209d13801ff80e05f6d61e65ca6f6b31135f2e0553f50c293091e9750f834
|
|
| MD5 |
b92c9c094c1208a1123e0f3009968a40
|
|
| BLAKE2b-256 |
0cba724ca6d63176d7cffb370632309cc0c53045f59151568004880d19d8edbf
|
File details
Details for the file inferencebench_mt-0.0.2-py3-none-any.whl.
File metadata
- Download URL: inferencebench_mt-0.0.2-py3-none-any.whl
- Upload date:
- Size: 16.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.14 {"installer":{"name":"uv","version":"0.11.14","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f6b40dd5b298b2e344a152632a01a69c5777aa0811a52bf10a76f95b5ed69b19
|
|
| MD5 |
7de9dd8d6705b1fb258f388b7abbec28
|
|
| BLAKE2b-256 |
3da8caa5dc8ebbcb26b511a4afc5e1b312199a9f17262d16a7cabf7d8e8b06d5
|
