Skip to main content

SimulEval: A Flexible Toolkit for Automated Machine Translation Evaluation

Project description


SimulEval is a general evaluation framework for simultaneous translation on text and speech. Full documentation can be found here.


git clone
cd SimulEval
pip install -e .

Quick Start

Following is the evaluation of a dummy agent which operates wait-k (k = 3) policy and generates random words until the length of the generated words is the same as the number of all the source words.

cd examples/quick_start
simuleval --source source.txt --target target.txt --agent


SimulEval is licensed under Creative Commons BY-SA 4.0.


Please cite as:

  title = {Simuleval: An evaluation toolkit for simultaneous translation},
  author = {Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, Juan Pino},
  booktitle = {Proceedings of the EMNLP},
  year = {2020},

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simuleval-1.1.4.tar.gz (582.6 kB view hashes)

Uploaded Source

Built Distribution

simuleval-1.1.4-py3-none-any.whl (47.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page