language form evaluation in python
Project description
Language Form Evaluation
This package includes efficient pure python implementation of the following metrics:
-
BLEU (in progress)
-
ROUGE (in progress)
-
- compared to the original implementation: https://github.com/vrama91/cider
- With the same tokenizer
- error: < 1 %
- speed: + 181 %
- With different tokenizer (formeval.cider use Regex from nltk)
- error: ~15 %
- speed: + 432 %
- With the same tokenizer
- compared to the original implementation: https://github.com/vrama91/cider
-
SPICE (in progress)
All stats represented above are rough estimation
Dependencies
- python 3.6 +
- nltk 3.5+
Setup
pip install formeval
optional setup
python3 -c 'import nltk; nltk.download("wordnet")'
Example Data
Usage
See run_examples.py
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
formeval-1.0.3.tar.gz
(4.5 kB
view hashes)