SimulEval

SimulEval is a general evaluation framework for simultaneous translation on text and speech. Full documentation can be found here.

Installation

git clone https://github.com/facebookresearch/SimulEval.git
cd SimulEval
pip install -e .

Quick Start

Following is the evaluation of a dummy agent which operates wait-k (k = 3) policy and generates random words until the length of the generated words is the same as the number of all the source words.

cd examples/quick_start
simuleval --source source.txt --target target.txt --agent first_agent.py

License

SimulEval is licensed under Creative Commons BY-SA 4.0.

Citation

Please cite as:

@inproceedings{simuleval2020,
  title = {Simuleval: An evaluation toolkit for simultaneous translation},
  author = {Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, Juan Pino},
  booktitle = {Proceedings of the EMNLP},
  year = {2020},
}

Development Status
- 4 - Beta
License
- OSI Approved :: Apache Software License
Operating System
- OS Independent
Programming Language
- Python :: 3

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simuleval-1.1.4.tar.gz (582.6 kB view details)

Uploaded Nov 30, 2023 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

simuleval-1.1.4-py3-none-any.whl (47.3 kB view details)

Uploaded Nov 30, 2023 Python 3

File details

Details for the file simuleval-1.1.4.tar.gz.

File metadata

Download URL: simuleval-1.1.4.tar.gz
Upload date: Nov 30, 2023
Size: 582.6 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for simuleval-1.1.4.tar.gz
Algorithm	Hash digest
SHA256	`e8fc17c217cf61044d6190e8f9b88d9b35f59edb4d2309a7a253c6cf32a78e08`
MD5	`9397641ef8a074839b3586af9026f905`
BLAKE2b-256	`ba11ddaec370a420450589334a5ad3f2804823ec537100e540d58eb5e50886d3`

See more details on using hashes here.

File details

Details for the file simuleval-1.1.4-py3-none-any.whl.

File metadata

Download URL: simuleval-1.1.4-py3-none-any.whl
Upload date: Nov 30, 2023
Size: 47.3 kB
Tags: Python 3
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for simuleval-1.1.4-py3-none-any.whl
Algorithm	Hash digest
SHA256	`6cdfae20a5cd2a7a1ca5879a23a448ee4c54aeee442fa30ad6e41f5313a36808`
MD5	`4863a0d9b50755e354a1e7a58a890a5c`
BLAKE2b-256	`040ef04e3cbc4542f4527848e2f77875af9f62b6cab0626eb7814caa89e8ec0a`