hatespans 0.2.0

Toxic Spans Prediction

HateSpans

We provide state-of-the-art models to detect toxic spans in text. We have evaluated our models on Toxic Spanstask at SemEval 2021 (Task 5).

Installation

You first need to install PyTorch. The recommended PyTorch version is 1.6. Please refer to PyTorch installation page regarding the specific install command for your platform.

When PyTorch has been installed, you can install HateSpans from pip.

From pip

pip install hatespans

Pretrained HateSpans Models

We will be keep releasing new models. Please keep in touch. We have evaluated the models on the trial set released for Toxic Spanstask at SemEval 2021.

Models	Average F1
en-base	0.6734
en-large	0.6886
multilingual-base	0.5953
multilingual-large	0.6013

Prediction

Following code can be used to predict toxic spans in text. Upon executing, it will download the relevant model and return the toxic spans.

from hatespans.app.hate_spans_app import HateSpansApp

app = HateSpansApp("en-base", use_cuda=False)
print(app.predict_hate_spans("You motherfucking cunt", spans=True))