Skip to main content

dhivehi_nlp

Natural language processing tools for the Dhivehi language.

Demo website to test features: https://dhivehi-nlp.herokuapp.com/

Installation

pip install dhivehi_nlp

Modules

Tokenizer - Tokenize text into separate sentences or words (tokens).

Stopwords - Remove stopwords from text and return the resulting tokens.

Stemmer - Remove suffixes from words to return their root form.

Language Models - Create language models to predict future additions. Language models will give probability based on selected ngram. An ngram is a contiguous sequence of n tokens from the given input text. Use previously built models to predict future words.

Dictionary - Get definitions of Dhivehi words and the word list. Definitions obtained from radheef.mv.

Corpus - Collections of various Dhivehi texts.

Trigram Similarity - Divides words or phrases into sequences of three consecutive letters, placed in a set where the order doesn't matter and duplicates are removed. Used to find string matches even if certain characters are different or out of order, based on similarity value.

Tagger - Tag words in text according to specified rules or patterns. For example, tagging words based on which part of speech it belongs to.

Metadata

Release files for dhivehi-nlp 1.0.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dhivehi-nlp 1.0.9
File Size Uploaded Provenance Actions
dhivehi_nlp-1.0.9.tar.gz 5.1 MB Without provenance Details for dhivehi_nlp-1.0.9.tar.gz

Release files / dhivehi_nlp-1.0.9.tar.gz

Download URL dhivehi_nlp-1.0.9.tar.gz
Size 5.1 MB
Tags Source
SHA-256 checksum
How to use checksums
6aece92e9fa6aa2f2bfaf3e694705a7b24dcc3c5cc29dcd8b8662e859b2c9197
BLAKE2b-256 checksum
How to use checksums
172337a98864d98472b3a77a8c15aea26525a0969b2f63ee6640fb02a7ae2f94
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.0

Security for dhivehi-nlp 1.0.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page