value-nlp 0.1.2

A Framework for Cross-Dialectal NLP

Multi-VALUE: The VernAcular Language Understanding Evaluation benchmark

Setup

Prerequisites:

• anaconda

1. Create a virtual environment

conda create --name value python=3.7.13
conda activate value

2. Install requirements:

pip install -r requirements.txt

3. Install spaCy English pipeline and nltk wordnet

bash downloads.sh

4. Confirm that your setup is correct by running the unittest

python -m unittest tests.py

Build Multi-VALUE CoQA (optional)

1. Pull data

bash pull_coqa.sh

2. Run for each dialect

python -m src.build_coqa_value --dialect aave &
python -m src.build_coqa_value --dialect appalachian &
python -m src.build_coqa_value --dialect chicano &
python -m src.build_coqa_value --dialect indian &
python -m src.build_coqa_value --dialect multi &
python -m src.build_coqa_value --dialect singapore &