Small library which aim is to check your dataset for being solved by simple heuristics. Multilingual!
Project description
check_your_heuristic
#Quick start
Installation
pip install check_your_heuristic
Configurations
To check your dataset fill the config, using unix-like paths.
Example config:
train_dataset_dir: "dataset/dir/train.jsonl"
valid_dataset_dir: "dataset/dir/val.jsonl"
column_name1: "premise"
column_name2: "hypothesis"
target_name: "label"
Other config variations can be found here
CLI Use
Our library offers four build-in commands for checking your datasets depending on the dataset structure you have
- Base case or two text columns + one target column (for example, CommitmentBank from SuperGLUE or TERRa from Russian SuperFLUE)
run-base-case --path_to_config config.yaml
- When you have some long text and some questions and answers for it (for example, MultiRC from SuperGLUE or MuSeRC from Russian SuperFLUE)
run-multirc-case --path_to_config config.yaml
- When you have passage, questions and some NERs (or entities) that serve as answers (for example, ReCoRD from SuperGLUE or RuCoS from Russian SuperFLUE)
run-record-case --path_to_config config.yaml
- Case when you have two cases and need to compare some words in them (for example, Words in Context (WiC) from SuperGLUE or RUSSE from Russian SuperFLUE)
run-wordincontext-case --path_to_config config.yaml
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
check_your_heuristic-0.0.2.tar.gz
(11.6 kB
view hashes)
Built Distribution
Close
Hashes for check_your_heuristic-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e0113b2374f96fe9419a174947cd7c6f242627c8ff191696ebd57c1d981d9f7 |
|
MD5 | 57cc69aa18130325199349d6d1eabd77 |
|
BLAKE2b-256 | 8b15994e49a76c9114a1ed247d1f8e6a046079e3f9fed18025625f8204568137 |
Close
Hashes for check_your_heuristic-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e353b16347dc5a83df1760b3fd7e83cbac0ffd22276ef82030b267bf1de4c353 |
|
MD5 | 12d1a67a0ef3b4f5e2cd48156d1b3af8 |
|
BLAKE2b-256 | e9de34972952915effbee735ba60b750ac487ba88cfdf1d16771f161fa32a2f3 |