SimulEval
SimulEval is a general evaluation framework for simultaneous translation on text and speech. Full documentation can be found here.
Installation
git clone https://github.com/facebookresearch/SimulEval.git
cd SimulEval
pip install -e .
Quick Start
Following is the evaluation of a dummy agent which operates wait-k (k = 3) policy and generates random words until the length of the generated words is the same as the number of all the source words.
cd examples/quick_start
simuleval --source source.txt --target target.txt --agent first_agent.py
License
SimulEval is licensed under Creative Commons BY-SA 4.0.
Citation
Please cite as:
@inproceedings{simuleval2020,
title = {Simuleval: An evaluation toolkit for simultaneous translation},
author = {Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, Juan Pino},
booktitle = {Proceedings of the EMNLP},
year = {2020},
}
Metadata
Release files for simuleval 1.1.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| simuleval-1.1.4.tar.gz | 582.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| simuleval-1.1.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 629.9 kB
Release files / simuleval-1.1.4.tar.gz
| Download URL | simuleval-1.1.4.tar.gz |
|---|---|
| Size | 582.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e8fc17c217cf61044d6190e8f9b88d9b35f59edb4d2309a7a253c6cf32a78e08
|
|
BLAKE2b-256 checksum How to use checksums |
ba11ddaec370a420450589334a5ad3f2804823ec537100e540d58eb5e50886d3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|
Release files / simuleval-1.1.4-py3-none-any.whl
| Download URL | simuleval-1.1.4-py3-none-any.whl |
|---|---|
| Size | 47.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
6cdfae20a5cd2a7a1ca5879a23a448ee4c54aeee442fa30ad6e41f5313a36808
|
|
BLAKE2b-256 checksum How to use checksums |
040ef04e3cbc4542f4527848e2f77875af9f62b6cab0626eb7814caa89e8ec0a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|
