No project description provided
Project description
EvaluateQA
Package for evaluate QA datasets and Leaderboard with SOTA approaches
Install
pip install evaluateqa
Supported datasets
Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering
from evaluateqa.mintaka import evaluate
predictions = {
'9ace9041': 'Q90',
'9ace9042': 3,
...
}
results = evaluate(
predictions,
split='test',
mode='kg',
lang='en',
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
evaluateqa-0.1.3.tar.gz
(5.2 kB
view hashes)
Built Distribution
Close
Hashes for evaluateqa-0.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 64bf48c4ef82a965c04f7e28bfde8927674a7c191b97d813953e1a89d4ace477 |
|
MD5 | 31ded66838a1108b0d10ec79371fd816 |
|
BLAKE2b-256 | 497643351edae9660350e7ab6bcb8ed57a5413432ff08cc78191218e238a6297 |