Language Form Evaluation for Python
Project description
Language Form Evaluation
This package includes efficient python implementation of the following metrics
- BLEU
- reference
implementation: nltk.translate.bleu_score
- error: < 1%
- speed: + 189%
- reference
implementation: nltk.translate.bleu_score
- ROUGE (in progress)
- METEOR (in progress)
- CIDEr/CIDEr-D
- reference implementation: https://github.com/vrama91/cider
- with the same tokenizer
- error: < 1 %
- speed: + 81 %
- with different tokenizers (FormEval use Regexp by default)
- error: ~ 15 %
- speed: + 332 %
- with the same tokenizer
- reference implementation: https://github.com/vrama91/cider
- SPICE
- placeholder wrapper of reference
implementation: https://github.com/tylin/coco-caption/tree/master/pycocoevalcap/spice
- TODO: python scene graph parser
- placeholder wrapper of reference
implementation: https://github.com/tylin/coco-caption/tree/master/pycocoevalcap/spice
*All stats shown above are estimations
Dependencies
- python 3.6 +
- nltk 3.5+
Setup
pip install formeval
python -m formeval.setup
Examples
Test Data
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
formeval-1.0.6.tar.gz
(12.3 kB
view details)
Built Distribution
formeval-1.0.6-py3-none-any.whl
(15.5 kB
view details)
File details
Details for the file formeval-1.0.6.tar.gz
.
File metadata
- Download URL: formeval-1.0.6.tar.gz
- Upload date:
- Size: 12.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a03e6b758a3a305f37a08f99e90baaf1e6adcc32d2acc0467e5b300785c54517 |
|
MD5 | b2fc84e7507024662a87b00e139bf956 |
|
BLAKE2b-256 | c66f2cec490c093b12aa3cf74d9e147b53641ef4b5e5ab8186ce66c65d847ca5 |
Provenance
File details
Details for the file formeval-1.0.6-py3-none-any.whl
.
File metadata
- Download URL: formeval-1.0.6-py3-none-any.whl
- Upload date:
- Size: 15.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee3140734978999f3226118808d9877b6c66d35432804c1ced4cdb30c9d73696 |
|
MD5 | 81fca425fc3e4c6f6b2012cab595a89a |
|
BLAKE2b-256 | df4e0cee616cd44c0380433a3579c402018a6144a2891135e4ceedabf1a42c33 |