Skip to main content
Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 5.3.8 instead.

PyThaiNLP: Thai Natural Language Processing in Python

Project Logo

pypi Python 3.9 License DOI Project Status: Active Codacy Grade Coverage Status Google Colab Badge Facebook Chat on Matrix

pythainlp.org | Tutorials | License info | Model cards | Adopters | เอกสารภาษาไทย

Designed to be a Thai-focused counterpart to NLTK, PyThaiNLP provides standard tools for linguistic analysis under an Apache-2.0 license, with its data and models covered by CC0-1.0 and CC-BY-4.0.

pip install pythainlp
Version Python version Changes Documentation
5.3.6 3.9+ Log pythainlp.org/docs
dev 3.9+ Log pythainlp.org/dev-docs

Features

  • Linguistic units: Sentence, word, and subword segmentation (sent_tokenize, word_tokenize, subword_tokenize).

  • Tagging: Part-of-speech tagging (pos_tag).

  • Transliteration: Romanization (transliterate) and IPA conversion.

  • Correction: Spelling suggestion and correction (spell, correct).

  • Utilities: Soundex, collation, number-to-text (bahttext), datetime formatting (thai_strftime), and keyboard layout correction.

  • Data: Built-in Thai character sets, word lists, and stop words.

  • CLI: Command-line interface via thainlp.

    thainlp data catalog  # List datasets
    thainlp help          # Show usage
    

Installation options

To install with specific extras (e.g., translate, wordnet, full):

pip install "pythainlp[extra1,extra2,...]"

Possible extras included:

  • compact — install a stable and small subset of dependencies (recommended)
  • translate — machine translation support
  • wordnet — WordNet support
  • full — install all optional dependencies (may introduce conflicts)

The documentation website maintains the full list of extras. To see the specific libraries included in each extra, please inspect the [project.optional-dependencies] section of pyproject.toml.

Environment variables

Variable Description Status
PYTHAINLP_DATA Path to the data directory (default: ~/pythainlp-data). Current
PYTHAINLP_DATA_DIR Legacy alias for PYTHAINLP_DATA. Emits a DeprecationWarning. Setting both raises ValueError. Deprecated; use PYTHAINLP_DATA
PYTHAINLP_OFFLINE Set to 1 to disable automatic corpus downloads. Explicit download() calls still work. Current
PYTHAINLP_READ_ONLY Set to 1 to enable read-only mode, which prevents implicit background writes to PyThaiNLP's internal data directory (corpus downloads, catalog updates, directory creation). Explicit user-initiated saves to user-specified paths are unaffected. Current
PYTHAINLP_READ_MODE Legacy alias for PYTHAINLP_READ_ONLY. Emits a DeprecationWarning. Setting both raises ValueError. Deprecated; use PYTHAINLP_READ_ONLY

Data directory

PyThaiNLP downloads data (see the data catalog db.json at pythainlp-corpus) to ~/pythainlp-data by default. Set the PYTHAINLP_DATA environment variable to override this location. (PYTHAINLP_DATA_DIR is still accepted but deprecated.)

When using PyThaiNLP in distributed computing environments (e.g., Apache Spark), set the PYTHAINLP_DATA environment variable inside the function that will be distributed to worker nodes. See details in the documentation.

Offline mode

Set PYTHAINLP_OFFLINE=1 to disable automatic corpus downloads. When this variable is set and a corpus is not already cached locally, a FileNotFoundError is raised instead of attempting a network download. Explicit calls to pythainlp.corpus.download() are unaffected. Use pythainlp.is_offline_mode() to check the current state programmatically.

import pythainlp
print(pythainlp.is_offline_mode())  # True if PYTHAINLP_OFFLINE=1

Read-only mode

Set PYTHAINLP_READ_ONLY=1 to prevent implicit background writes to PyThaiNLP's internal data directory. This blocks corpus downloads, catalog updates, and automatic data directory creation — writes that happen as side effects the user may not be aware of.

Note: Read-only mode is more restrictive than offline mode. PYTHAINLP_OFFLINE=1 blocks only automatic downloads triggered by get_corpus_path(); explicit pythainlp.corpus.download() calls still work. PYTHAINLP_READ_ONLY=1 also blocks explicit download() calls, because any download requires writing to the data directory. Use PYTHAINLP_READ_ONLY when the data directory is on a read-only file system (e.g., a read-only Docker volume or a shared cluster mount).

Operations where the user explicitly specifies an output path are unaffected (e.g., model.save("path"), tagger.train(..., save_loc="path"), thainlp misspell --output myfile.txt).

Use pythainlp.is_read_only_mode() to check the current state programmatically.

import pythainlp
print(pythainlp.is_read_only_mode())  # True if PYTHAINLP_READ_ONLY=1

Testing

We test core functionalities on all officially supported Python versions.

See tests/README.md for test matrix and other details.

Contribute to PyThaiNLP

Please fork and create a pull request. See CONTRIBUTING.md for guidelines and algorithm references.

Citations

If you use PyThaiNLP library in your project, please cite the software as follows:

Phatthiyaphaibun, Wannaphong, Korakot Chaovavanich, Charin Polpanumas, Arthit Suriyawongkul, Lalita Lowphansirikul, and Pattarawat Chormai. “PyThaiNLP: Thai Natural Language Processing in Python”. Zenodo, 2 June 2024. https://doi.org/10.5281/zenodo.3519354.

with this BibTeX entry:

@software{pythainlp,
    title = "{P}y{T}hai{NLP}: {T}hai Natural Language Processing in {P}ython",
    author = "Phatthiyaphaibun, Wannaphong  and
      Chaovavanich, Korakot  and
      Polpanumas, Charin  and
      Suriyawongkul, Arthit  and
      Lowphansirikul, Lalita  and
      Chormai, Pattarawat",
    doi = {10.5281/zenodo.3519354},
    license = {Apache-2.0},
    month = jun,
    url = {https://github.com/PyThaiNLP/pythainlp/},
    version = {v5.0.4},
    year = {2024},
}

To cite our NLP-OSS 2023 academic paper, please cite the paper as follows:

Wannaphong Phatthiyaphaibun, Korakot Chaovavanich, Charin Polpanumas, Arthit Suriyawongkul, Lalita Lowphansirikul, Pattarawat Chormai, Peerat Limkonchotiwat, Thanathip Suntorntip, and Can Udomcharoenchaikit. 2023. PyThaiNLP: Thai Natural Language Processing in Python. In Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software (NLP-OSS 2023), pages 25–36, Singapore, Singapore. Empirical Methods in Natural Language Processing.

with this BibTeX entry:

@inproceedings{phatthiyaphaibun-etal-2023-pythainlp,
    title = "{P}y{T}hai{NLP}: {T}hai Natural Language Processing in {P}ython",
    author = "Phatthiyaphaibun, Wannaphong  and
      Chaovavanich, Korakot  and
      Polpanumas, Charin  and
      Suriyawongkul, Arthit  and
      Lowphansirikul, Lalita  and
      Chormai, Pattarawat  and
      Limkonchotiwat, Peerat  and
      Suntorntip, Thanathip  and
      Udomcharoenchaikit, Can",
    editor = "Tan, Liling  and
      Milajevs, Dmitrijs  and
      Chauhan, Geeticka  and
      Gwinnup, Jeremy  and
      Rippeth, Elijah",
    booktitle = "Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software (NLP-OSS 2023)",
    month = dec,
    year = "2023",
    address = "Singapore, Singapore",
    publisher = "Empirical Methods in Natural Language Processing",
    url = "https://aclanthology.org/2023.nlposs-1.4",
    pages = "25--36",
    abstract = "We present PyThaiNLP, a free and open-source natural language processing (NLP) library for Thai language implemented in Python. It provides a wide range of software, models, and datasets for Thai language. We first provide a brief historical context of tools for Thai language prior to the development of PyThaiNLP. We then outline the functionalities it provided as well as datasets and pre-trained language models. We later summarize its development milestones and discuss our experience during its development. We conclude by demonstrating how industrial and research communities utilize PyThaiNLP in their work. The library is freely available at https://github.com/pythainlp/pythainlp.",
}

Sponsors

See SPONSORS.md

Acknowledgements

PyThaiNLP was founded by Wannaphong Phatthiyaphaibun in 2016. His contributions from 2021 were made during a PhD studentship supported by Vidyasirimedhi Institute of Science and Technology (VISTEC).

The contributions of Arthit Suriyawongkul to PyThaiNLP from November 2017 until August 2019 were funded by Wisesight. His contributions from November 2019 until October 2024 were made during a PhD studentship supported by Taighde Éireann – Research Ireland under Grant Number 18/CRT/6224 (Research Ireland Centre for Research Training in Digitally-Enhanced Reality (d-real)).

The contributions of Pattarawat Chormai to PyThaiNLP from 2018 until 2019 were made during a research internship at the Natural Language Processing Lab, Department of Linguistics, Faculty of Arts, Chulalongkorn University.

The contributions of Korakot Chaovavanich and Lalita Lowphansirikul to PyThaiNLP from 2019 until 2022 were funded by the VISTEC-depa Thailand AI Research Institute.

The Mac Mini M1 used for macOS testing was donated by MacStadium. This hardware was essential for the project's testing suite from October 2022 to October 2023, filling a critical gap before GitHub Actions introduced native support for Apple Silicon runners.

We have only one official repository at https://github.com/PyThaiNLP/pythainlp and another mirror at https://gitlab.com/pythainlp/pythainlp.

Beware of malware if you use code from places other than these two.

Made with ❤️ | PyThaiNLP Team 💻 | "We build Thai NLP" 🇹🇭

Release files for pythainlp 5.3.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pythainlp 5.3.6
File Size Uploaded
pythainlp-5.3.6.tar.gz 21.3 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for pythainlp 5.3.6
File Interpreter ABI Platform
pythainlp-5.3.6-py3-none-any.whl Python 3 none any Details

Total release size: 43.2 MB

Release files / pythainlp-5.3.6.tar.gz

Download URL pythainlp-5.3.6.tar.gz
Size 21.3 MB
Tags Source
SHA-256 checksum
How to use checksums
6fbedddf6a88213326e724850be139060ff4125870e8e12b46ee58343158345c
BLAKE2b-256 checksum
How to use checksums
b37a0631dae2501e58f48d0828c62c382914a5fe79c689dd3bd71cb587106151
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / pythainlp-5.3.6-py3-none-any.whl

Download URL pythainlp-5.3.6-py3-none-any.whl
Size 21.9 MB
Tags Python 3
SHA-256 checksum
How to use checksums
2b60d4b7d61acdda6ce2f5e126756e4067455f11e01c27af6bb0d53aca05c01b
BLAKE2b-256 checksum
How to use checksums
c9b2f3c0ebf790e8bdcdb92f7762e7f0c94fc561f0785dd801872f8b215719b8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release history Release notifications | RSS feed

5.3.8

2 release files

5.3.7

2 release files

This release

5.3.6 This release

2 release files

5.3.5

2 release files

5.3.4

2 release files

5.3.3

2 release files

5.3.2

2 release files

5.3.1

2 release files

5.3.0

2 release files

5.2.0

2 release files

5.1.2

2 release files

5.1.1

2 release files

5.1.0

2 release files

5.0.5

2 release files

5.0.4

2 release files

5.0.3

2 release files

5.0.2

2 release files

5.0.1

2 release files

5.0.0

2 release files

4.0.2

2 release files

4.0.1

2 release files

4.0.0

2 release files

3.1.1

2 release files

3.1.0

2 release files

3.0.10

2 release files

3.0.9

2 release files

3.0.8

2 release files

3.0.7

2 release files

3.0.5

2 release files

3.0.4

2 release files

3.0.3

2 release files

3.0.2

2 release files

3.0.1

2 release files

3.0.0

2 release files

2.3.2

2 release files

2.3.1

2 release files

2.3.0

2 release files

2.2.6

2 release files

2.2.5

2 release files

2.2.4

2 release files

2.2.3

2 release files

2.2.2

2 release files

2.2.1

2 release files

2.2.0

2 release files

2.1.4

1 release file

2.1.3

1 release file

2.1.2

1 release file

2.1.1

1 release file

2.1

1 release file

2.0.7

1 release file

2.0.6

1 release file

2.0.5

2 release files

2.0.4

2 release files

2.0.3

2 release files

2.0.2

1 release file

2.0.1

1 release file

2.0

1 release file

1.7.4

1 release file

1.7.3

1 release file

1.7.2

1 release file

1.7.1

1 release file

1.7.0.1

1 release file

1.7.0

1 release file

1.6.0.7

1 release file

1.6.0.6

1 release file

1.6.0.5

1 release file

1.6.0.1

1.5.4.2

1 release file

1.5.4

1 release file

1.5.3

1 release file

1.5.2

1 release file

1.5.1

1 release file

1.5

1 release file

1.4.1

1 release file

1.4

1.3

2 release files

1.2

2 release files

1.1

2 release files

1.0.0

2 release files

0.0.9

1 release file

0.0.8

1 release file

0.0.7

1 release file

0.0.6

1 release file

0.0.5

1 release file

0.0.4

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page