tigrigna-nlp 0.1.0

The first complete Tigrigna (ትግርኛ) NLP toolkit

tigrigna-nlp

The first and best Tigrigna (ትግርኛ) NLP toolkit in the world
Production-ready • 100% offline • Perfect Ge’ez support

Why this is the BEST Tigrigna tokenizer ever made

Problem in other tokenizers	tigrigna-nlp solution
Merges words (ሰላምዓለም)	Never merges — always separate
Breaks Ge’ez punctuation	Perfect spacing around ፡ ። ፣ ፤ ፥ ፧ ፨
Shows <unk>, </s>, ▁ junk	100% clean, human-readable output
Requires internet/GPU/server	100% offline — 2 MB file only
Not trained on real Tigrigna	Built on Meta’s NLLB-200 (trained on real Tigrigna)

Features

• tokenize(text) → Clean list of tokens

• normalize(text) → Standardizes variants (ሃ→ሀ, ሠ→ሰ, etc.)

• get_tokenizer() → Raw Hugging Face tokenizer (advanced users)

• Works on Windows, macOS, Linux, Android, Raspberry Pi

• Zero internet required after installation

Quick Start

pip install tigrigna-nlp

from tigrigna_nlp import tokenize, normalize

text = "እግዚአብሔር ይደልዎም።"

tokens = tokenize(normalize(text))

print(tokens) => ['እግዚአብሔር', 'ይደልዎም', '።']

Use Cases

• Training Tigrigna BERT / LLaMA / mT5
• English ↔ Tigrigna machine translation
• Named Entity Recognition (NER)
• Speech-to-text preprocessing
• Sentiment analysis & text classification
• Tigrigna search engines

Citation

@software{tigrigna-nlp-2025, author = {Haile}, title = {tigrigna-nlp: The First Complete Tigrigna NLP Toolkit}, year = 2025, publisher = {PyPI}, version = {0.1.0}, url = {https://github.com/haile21/tigrigna-nlp} }

Author

Haile, Senior Software Developer

• Email: [e-mail]
• GitHub: @haile21

Join the Movement

Help us build the future of Tigrigna AI:

• First Tigrigna BERT
• First Tigrigna LLaMA
• Speech recognition & TTS
• Translation engine
• NER & POS datasets

GitHub: https://github.com/haile21/tigrigna-nlp

PyPI: https://pypi.org/project/tigrigna-nlp

Hugging Face: https://huggingface.co/tigrigna-nlp