dhivehi_nlp
Natural language processing tools for the Dhivehi language.
Demo website to test features: https://dhivehi-nlp.herokuapp.com/
Installation
pip install dhivehi_nlp
Modules
Tokenizer - Tokenize text into separate sentences or words (tokens).
Stopwords - Remove stopwords from text and return the resulting tokens.
Stemmer - Remove suffixes from words to return their root form.
Language Models - Create language models to predict future additions. Language models will give probability based on selected ngram. An ngram is a contiguous sequence of n tokens from the given input text. Use previously built models to predict future words.
Dictionary - Get definitions of Dhivehi words and the word list. Definitions obtained from radheef.mv.
Corpus - Collections of various Dhivehi texts.
Trigram Similarity - Divides words or phrases into sequences of three consecutive letters, placed in a set where the order doesn't matter and duplicates are removed. Used to find string matches even if certain characters are different or out of order, based on similarity value.
Tagger - Tag words in text according to specified rules or patterns. For example, tagging words based on which part of speech it belongs to.
1 maintainer
Metadata
1 maintainer
Release files for dhivehi-nlp 1.0.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| dhivehi_nlp-1.0.8.tar.gz | 5.1 MB | Details |
Release files / dhivehi_nlp-1.0.8.tar.gz
| Download URL | dhivehi_nlp-1.0.8.tar.gz |
|---|---|
| Size | 5.1 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5bd4c6abedbb0111e293c2eb367a1cef79c0694dd901b07e005611fba85a13f2
|
|
BLAKE2b-256 checksum How to use checksums |
d43d17d798b5c50351142305d9427506fa0ec9e81fdb497d8b2d2b2a35210117
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.0
|
