hfloader 1.0.2

A package that loads a tokenizer and model from the HuggingFace model hub.

HFLoader - Hugging Face Model Loader

This package provides the user with one method that returns both a tokenizer and a model when loading HuggingFace Models, without the need for knowing which AutoModel to use.

This package utilizes the transformers library to load a tokenizer and model, without having to know the AutoModel. This means that with one command, you can easily load the tokenizer and model of a given model on HuggingFace Model Hub. This can then be easily fed into the pipeline function of transformers.

Installation

The package can be installed with the following command:

pip install hfloader

How to Use

Here is a bit of code you can reference to see how to use the package.

import hfloader as hfl

huggingface_model = "cardiffnlp/twitter-roberta-base-sentiment"
tokenizer, model = hfl.load_model(huggingface_model)

pipe = pipeline("text-generation", model=model, tokenizer=tokenizer, torch_dtype=torch.bfloat16, device_map="auto")

The return of the command load_model() is going to be a tokenizer and a model, which can then be used in the pipeline method provided by transformers. It does so without the need to know which AutoModel to use, which can prove to be a hassle when trying out different models.

Requirements

pip install transformers

Notes

I don't have plans to upkeep this project unless it necessitates it. I was able to achieve the goal I had set out when developing the package.