hierarchy-transformers 0.0.1

Language models as hierarchy encoders.

Hierarchy Transformers (HiTs)

Code repository for the paper: "Language Models as Hierarchy Encoders".

Main Dependencies

This repository follows a similar layout as the sentence_transformers library. It mainly depends on the following libraries:

• Sentence Transformers for language models.

• DeepOnto for processing hierarchies and constructing datasets from hierarchies.

• Geoopt for arithmetic in hyperbolic space.

Models on Huggingface Hub

Our HiT models will be released on the Huggingface Hub.

Datasets

Datasets for HiTs are available at Zenodo, including those constructed from:

• WordNet
• SNOMED CT
• Schema.org
• FoodOn
• DOID