No project description provided
Project description
EvaluateQA
Package for evaluate QA datasets and Leaderboard with SOTA approaches
Install
pip install evaluateqa
Supported datasets
Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering
from evaluateqa.mintaka import evaluate
predictions = {
'9ace9041': 'Q90',
'9ace9042': 3,
...
}
results = evaluate(
predictions,
split='test',
mode='kg',
lang='en',
)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
evaluateqa-0.1.3.tar.gz
(5.2 kB
view details)
Built Distribution
File details
Details for the file evaluateqa-0.1.3.tar.gz.
File metadata
- Download URL: evaluateqa-0.1.3.tar.gz
- Upload date:
- Size: 5.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.8.10 Linux/5.15.0-56-generic
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8013f685cbd568ca6861bff243f89e34481deda022a57bd09f189e63ae4072e1 |
|
| MD5 | 5a9fa8a387c38301f6651d4035ca317e |
|
| BLAKE2b-256 | 7bb295ab77c4956c7d170f4fdae0d3fb2c1cd6b74b92b6771751d146c20665a8 |
File details
Details for the file evaluateqa-0.1.3-py3-none-any.whl.
File metadata
- Download URL: evaluateqa-0.1.3-py3-none-any.whl
- Upload date:
- Size: 6.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.8.10 Linux/5.15.0-56-generic
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 64bf48c4ef82a965c04f7e28bfde8927674a7c191b97d813953e1a89d4ace477 |
|
| MD5 | 31ded66838a1108b0d10ec79371fd816 |
|
| BLAKE2b-256 | 497643351edae9660350e7ab6bcb8ed57a5413432ff08cc78191218e238a6297 |
