Project description

Natural Language Toolkit for Boyig (BoNLTK)

BoNLTK aims to provide out of the box support for various NLP tasks that an application developer might need for Boyig (TIbetan) language.

pip install bonltk

Comming soon

Tokenizers:
- Hugging face tokenizers
- sentencepiece tokenizer
- Compare above tokenizers with botok
WordVectors:
- Word2Vec with gensim
- Emlo
Language Models:
- Huggingface transformers
- UMLFit Language model with fastai
Text Similarity:
- Sentence similarity using UMLFit, like in inltk
- Implement Text similarity techniques mention in [here]((https://medium.com/@adriensieg/text-similarities-da019229c894)
- Compare all the text similarity algorithms

These details have not been verified by PyPI

This version

0.0.4

Nov 16, 2020

0.0.3

Nov 13, 2020

0.0.2

Nov 13, 2020

0.0.1

Nov 13, 2020

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Nov 16, 2020 Source

Uploaded Nov 16, 2020 Python 3

Details for the file bonltk-0.0.4.tar.gz.

Download URL: bonltk-0.0.4.tar.gz
Upload date: Nov 16, 2020
Size: 9.3 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.5

Details for the file bonltk-0.0.4-py3-none-any.whl.

Download URL: bonltk-0.0.4-py3-none-any.whl
Upload date: Nov 16, 2020
Size: 8.1 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.5

Hashes for bonltk-0.0.4-py3-none-any.whl
Algorithm	Hash digest
SHA256	`18f75148679301ab2e540c7c178b650e56fc3cf1eed118ebe75587dfccbb72ca`
MD5	`e115d4bb2629ee67a2e9fe6feec99057`
BLAKE2b-256	`e57077798ed2a66dcffbc44c89dcfc260cba3cf68c56d92f606d0cd3a7ea5c41`