pythainlp 2.0

Thai Natural Language Processing library

PyThaiNLP 2.0

PyThaiNLP is a Python library for natural language processing (NLP) of Thai language.

PyThaiNLP includes Thai word tokenizers, transliterators, soundex converters, part-of-speech taggers, and spell checkers.

📖 For details on upgrading from PyThaiNLP 1.7 to PyThaiNLP 2.0, see From PyThaiNLP 1.7 to PyThaiNLP 2.0

📖 For ThaiNER user after upgrading from PyThaiNLP 1.7 to PyThaiNLP 2.0, see Upgrade ThaiNER from PyThaiNLP 1.7 to PyThaiNLP 2.0

📫 follow us on Facebook Pythainlp

What's new in version 2.0 ?

• New NorvigSpellChecker spell checker class, which can be initialized with custom dictionary.
• Terminate Python 2 support. Remove all Python 2 compatibility code.
• Remove old, obsolated, deprecated, and experimental code.
• Thai2fit (Upgrade ULMFiT-related codes to fastai 1.0)
• ThaiNER 1.0
• Remove sentiment analysis
• Improved word_tokenize (newmm, mm) and dict_word_tokenize
• Improved POS-tagging
• More and improved examples
• see PyThaiNLP 2.0 change log

Install

For stable version:

pip install pythainlp

For some advanced functionalities, like word vector, extra packages may be needed. Install them with these options during pip install:

pip install pythainlp[extra1,extra2,...]

where extras can be

• artagger (to support artagger part-of-speech tagger)*
• deepcut (to support deepcut machine-learnt tokenizer)
• icu (for ICU support in transliteration and tokenization)
• ipa (for International Phonetic Alphabet support in transliteration)
• ml (to support fastai 1.0.22 ULMFiT models)
• ner (for named-entity recognizer)
• thai2fit (for Thai word vector)
• thai2rom (for machine-learnt romanization)
• full (install everything)

Note for Windows: marisa-trie wheels can be obtained from https://www.lfd.uci.edu/~gohlke/pythonlibs/#marisa-trie Install it with pip, for example: pip install marisa_trie‑0.7.5‑cp36‑cp36m‑win32.whl

Links

• User guide : English , ภาษาไทย
• Docs: https://thainlp.org/pythainlp/docs/2.0/
• GitHub: https://github.com/PyThaiNLP/pythainlp
• Issues: https://github.com/PyThaiNLP/pythainlp/issues
• Facebook : Pythainlp