Supernova

Supernova NepaliFast V5 tokenizer.

Installation

pip install supernova

Usage

from supernova import Tokenizer

tokenizer = Tokenizer("v5")

tokens = tokenizer.encode("नेपाल राम्रो छ।")
text = tokenizer.decode(tokens)

print(tokens)
print(text)

Metadata

Release files for supernova-v5 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for supernova-v5 0.1.0
File	Interpreter	ABI	Platform	Reset
supernova_v5-0.1.0-py3-none-any.whl 14.4 kB Oct 1, 2026	Python 3	none	any	Details

Release files / supernova_v5-0.1.0-py3-none-any.whl

Download URL	supernova_v5-0.1.0-py3-none-any.whl
Size	14.4 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`f246414cc22cb0735b7b958a4f1426c1977250676a6e4c4efeb9befb2b9b8e35`
BLAKE2b-256 checksum How to use checksums	`5f86598e1d44485d03e98bd338ae8fafa73030dd33f2e045efb9f71c84af4aa0`
Upload date	Oct 1, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.13.15`