Nepali Stemmer
This is a simple Nepali stemmer. It iteratively separates out the suffixes (postpositions) until no more separation can be processed. The algorithm is based on hindi-stemmer.
Features:
- Iterative separation
- Handles the postposition attached with punctuations carefully
- Example: नेपाललाई, -> नेपाल लाई,
- Basic text cleaning
- Cross-verification with Nepali dictionary
How to run
>>> from nepali_stemmer.stemmer import NepStemmer
>>> nepstem = NepStemmer()
>>> nepstem.stem("नेपालको एमाले पार्टीका झोले, मण्डलेहरु अमेरिका आउने रे !")
'नेपाल को एमाले पार्टी का झोले, मण्डले हरु अमेरिका आउने रे !'
To-do:
- Word transformation with stemming process
- IR evaluation
- Code-mixed data
References:
- Suffix list: https://github.com/birat-bade/NepaliStemmer
- Nepali Dictionary : https://github.com/PraveshKoirala/stemmer
- Algorithm : https://github.com/sainimohit23/hindi-stemmer
Contact
Email: oyashi
Note: Project created during COVID-19 quarantine out-of-boredom and necessity
Release files for nepali-stemmer 0.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| nepali-stemmer-0.0.2.tar.gz | 144.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| nepali_stemmer-0.0.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 293.8 kB
Release files / nepali-stemmer-0.0.2.tar.gz
| Download URL | nepali-stemmer-0.0.2.tar.gz |
|---|---|
| Size | 144.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c18723468c0fd73cc91ea860e402b6f282cf0885e96919465bc0203747b5d0e8
|
|
BLAKE2b-256 checksum How to use checksums |
70558ebc655ebf54eca51bd67d684bbb80e7a37111dc145730b2c00edf09df09
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.6.9
|
Release files / nepali_stemmer-0.0.2-py3-none-any.whl
| Download URL | nepali_stemmer-0.0.2-py3-none-any.whl |
|---|---|
| Size | 149.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c2a446f13ccbd6f81f7cc130a5d293f67ef91392ed785ed65954c7fea011478a
|
|
BLAKE2b-256 checksum How to use checksums |
a7c153db9fef18d13b1ee6b02044e56fffd04e697225ac03e113c9d8d7db3bdd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.6.9
|