BNLP is a natural language processing toolkit for Bengali Language
Project description
Bengali Natural Language Processing(BNLP)
BNLP is a natural language processing toolkit for Bengali Language. This tool will help you to tokenize Bengali text, Embedding Bengali words, Embedding Bengali Document, Bengali POS Tagging, Bengali Name Entity Recognition, Bangla Text Cleaning for Bengali NLP purposes.
Documentation
Full documentation are available here
Features
- Tokenization
- Embeddings
- Part of speech tagging
- Named Entity Recognition
- Text Cleaning
- Corpus
- Letters, vowels, punctuations, stopwords
Installation
PIP installer
pip install bnlp_toolkit
or Upgrade
pip install -U bnlp_toolkit
- Python: 3.6, 3.7, 3.8, 3.9, 3.10
- OS: Linux, Windows, Mac
Build from source
git clone https://github.com/sagorbrur/bnlp.git
cd bnlp
python setup.py install
Sample Usage
from bnlp import BasicTokenizer
tokenizer = BasicTokenizer()
raw_text = "আমি বাংলায় গান গাই।"
tokens = tokenizer(raw_text)
print(tokens)
# output: ["আমি", "বাংলায়", "গান", "গাই", "।"]
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bnlp_toolkit-4.0.0.dev2.tar.gz
(17.9 kB
view hashes)
Built Distribution
Close
Hashes for bnlp_toolkit-4.0.0.dev2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b337c990e0a09418e084b6f058f9f2dce5035e61e9648be2ce15d139e23aa18a |
|
MD5 | 4d9b8ece8d612a5428ea790d265d4376 |
|
BLAKE2b-256 | 394e82f25e13b7b3f2e15a53e8270ec246ff443779267416db142a1dc16a4101 |