ne-embed 1.0.0

Multilingual text embeddings for Northeast Indian languages

ne-embed

Multilingual text embeddings for Northeast Indian languages.

10 languages · 768 dimensions · Built on LaBSE · CC-BY-4.0

Install

pip install ne-embed

Usage

from ne_embed import NEEmbed

model = NEEmbed()  # downloads from HuggingFace on first run

sentences = [
    'Where is the nearest hospital?',
    'Ngi la pynjot ia ki shnong baroh',  # Khasi
    'Pilakchin an senganiko man na.',     # Garo
]

embeddings = model.encode(sentences)
print(embeddings.shape)  # (3, 768)

model.languages()  # print supported languages

Supported Languages

Code	Language	Tier
asm	Assamese	Supported
brx	Bodo	Supported
grt	Garo	Supported
kha	Khasi	Supported
lus	Mizo	Supported
mni	Meitei	Supported
njz	Nyishi	Supported
trp	Kokborok	Limited
pbv	Pnar	Limited
nag	Nagamese	Limited

Links

• HuggingFace
• MWire Labs