nerblackbox 0.0.8

fine-tune transformer-based models for named entity recognition

A python package to fine-tune transformer-based models for Named Entity Recognition (NER).

Resources

• Source Code: https://github.com/af-ai-center/nerblackbox

• Documentation: https://af-ai-center.github.io/nerblackbox

• PyPI: https://pypi.org/project/nerblackbox

About

Transformer-based models like BERT have had a game-changing impact on Natural Language Processing.

In order to utilize the publicly accessible pretrained models for Named Entity Recognition, one needs to retrain (or “fine-tune”) them using labeled text.

nerblackbox makes this easy.

You give it

• a Dataset (labeled text)

• a Pretrained Model (transformers)

and you get

• the best Fine-tuned Model

• its Performance on the dataset

Installation

pip install nerblackbox

Usage

Fine-tuning can be done in a few simple steps using an “experiment configuration file”

# cat <experiment_name>.ini
dataset_name = swedish_ner_corpus
pretrained_model_name = af-ai-center/bert-base-swedish-uncased

and either the Command Line Interface (CLI) or the Python API:

# CLI
nerbb run_experiment <experiment_name>          # fine-tune
nerbb get_experiment_results <experiment_name>  # get results/performance
nerbb predict <experiment_name> <text_input>    # apply best model

# Python API
nerbb = NerBlackBox()
nerbb.run_experiment(<experiment_name>)         # fine-tune
nerbb.get_experiment_results(<experiment_name>) # get results/performance
nerbb.predict(<experiment_name>, <text_input>)  # apply best model