th-preprocessor
Simple Thai Preprocess Functions
Objectives
This repository provides simple preprocess techniques for Thai sentences/phrases
Supports
The module supports Python 3.6+
Installation
pip install th-simple-preprocessor
How to Use
from th_preprocessor.preprocess import preprocess
text = '"::::: อย่างไรก็ตามนูร์ ฮิชัม อับดุลเลาะห์ 21-09-2018 https://www.malaysiakini.com/news/444015"'
words = preprocess(text)
print(words)
# อย่างไรก็ตามนูร์ ฮิชัม อับดุลเลาะห์ WSNUMBER WSNUMBER WSNUMBER WSLINK
Package reference:
th_preprocessor.preprocess.normalize_linkth_preprocessor.preprocess.normalize_at_mentionth_preprocessor.preprocess.normalize_emailth_preprocessor.preprocess.normalize_hahath_preprocessor.preprocess.normalize_numth_preprocessor.preprocess.normalize_phoneth_preprocessor.preprocess.normalize_accented_charsth_preprocessor.preprocess.normalize_special_charsth_preprocessor.preprocess.remove_hashtagsth_preprocessor.preprocess.remove_tagth_preprocessor.preprocess.remove_dup_spacesth_preprocessor.preprocess.remove_emojith_preprocessor.preprocess.replace_dup_charsth_preprocessor.preprocess.replace_dup_emojisth_preprocessor.preprocess.insert_spacesth_preprocessor.preprocess.normalize_emojith_preprocessor.preprocess.remove_others_charth_preprocessor.preprocess.remove_stopwordsth_preprocessor.preprocess.preprocess
Copyright
All licenses in this repository are copyrighted by their respective authors. Everything else is released under CC0. See LICENSE for details.
Release files for th-simple-preprocessor 0.10.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| th-simple-preprocessor-0.10.1.tar.gz | 21.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| th_simple_preprocessor-0.10.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 42.0 kB
Release files / th-simple-preprocessor-0.10.1.tar.gz
| Download URL | th-simple-preprocessor-0.10.1.tar.gz |
|---|---|
| Size | 21.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5900044680ab3681571216f043ace1b4e01e46dacb88ca55643c8293782817ba
|
|
BLAKE2b-256 checksum How to use checksums |
6c530dc483089e5efec48e0f3ed57fec4b1c18c360cc37256cb5ccffbe8e6e12
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.9.12
|
Release files / th_simple_preprocessor-0.10.1-py3-none-any.whl
| Download URL | th_simple_preprocessor-0.10.1-py3-none-any.whl |
|---|---|
| Size | 20.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
be0264d87aeed90612baea860cb09b2481f1127b8ff12fe655577e4e4b8ad486
|
|
BLAKE2b-256 checksum How to use checksums |
d73ea76ec468700d4fc2405c74d4bd733cd97b670d2c7cd6d1177add152dc975
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.9.12
|
