EvaluateQA
Package for evaluate QA datasets and Leaderboard with SOTA approaches
Install
pip install evaluateqa
Supported datasets
Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering
from evaluateqa.mintaka import evaluate
predictions = {
'9ace9041': 'Q90',
'9ace9042': 3,
...
}
results = evaluate(
predictions,
split='test',
mode='kg',
lang='en',
)
1 maintainer
Metadata
1 maintainer
Release files for evaluateqa 0.1.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| evaluateqa-0.1.3.tar.gz | 5.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| evaluateqa-0.1.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 11.3 kB
Release files / evaluateqa-0.1.3.tar.gz
| Download URL | evaluateqa-0.1.3.tar.gz |
|---|---|
| Size | 5.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8013f685cbd568ca6861bff243f89e34481deda022a57bd09f189e63ae4072e1
|
|
BLAKE2b-256 checksum How to use checksums |
7bb295ab77c4956c7d170f4fdae0d3fb2c1cd6b74b92b6771751d146c20665a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.5.1 CPython/3.8.10 Linux/5.15.0-56-generic
|
Release files / evaluateqa-0.1.3-py3-none-any.whl
| Download URL | evaluateqa-0.1.3-py3-none-any.whl |
|---|---|
| Size | 6.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
64bf48c4ef82a965c04f7e28bfde8927674a7c191b97d813953e1a89d4ace477
|
|
BLAKE2b-256 checksum How to use checksums |
497643351edae9660350e7ab6bcb8ed57a5413432ff08cc78191218e238a6297
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.5.1 CPython/3.8.10 Linux/5.15.0-56-generic
|
