Skip to main content

Natural-Language-Toolkit for bahasa Malaysia, powered by Deep Learning.

Project description

.. figure:: https://raw.githubusercontent.com/DevconX/Malaya/master/session/towns-of-malaya.jpg

|Downloads| |Downloads GPU| |Latest Version| |Python Version| |MIT| |Build Status| |Documentation Status|

.. |Latest Version| image:: https://badge.fury.io/py/malaya.svg
:target: https://pypi.python.org/pypi/malaya
.. |MIT| image:: https://img.shields.io/badge/License-MIT-yellow.svg
:target: https://github.com/huseinzol05/Malaya/blob/master/LICENSE
.. |Python Version| image:: https://img.shields.io/pypi/pyversions/malaya.svg
:target: https://pypi.python.org/pypi/malaya
.. |Build Status| image:: https://travis-ci.org/huseinzol05/Malaya.svg?branch=master
:target: https://travis-ci.org/huseinzol05/Malaya
.. |Documentation Status| image:: https://readthedocs.org/projects/malaya/badge/?version=latest
:target: https://malaya.readthedocs.io/

Natural-Language-Toolkit for bahasa Malaysia, powered by Deep Learning
Tensorflow.

Documentation
--------------

Proper documentation is available at https://malaya.readthedocs.io/

Installing from the PyPI
----------------------------------

CPU version
::

$ pip install malaya

GPU version
::

$ pip install malaya-gpu

Only **Python 3.6.x** is supported.

Features
--------

- **Emotion Analysis**

From BERT, Fast-Text, Dynamic-Memory Network, Sparse Tensorflow, Attention Neural Network to build deep emotion analysis models.
- **Entities Recognition**

Latest state-of-art CRF deep learning models to do Naming Entity Recognition.
- **Language Detection**

using Multinomial, SGD, XGB, Fast-text N-grams deep learning to distinguish Malay, English, and Indonesian.
- **Normalizer**

using local Malaysia NLP researches to normalize any
bahasa texts.
- **Num2Word**

Convert from numbers to cardinal or ordinal representation.
- **Part-of-Speech Recognition**

Latest state-of-art CRF deep learning models to do Naming Entity Recognition.
- **Dependency Parsing**

Latest state-of-art CRF deep learning models to do analyzes the grammatical structure of a sentence, establishing relationships between words.
- **Sentiment Analysis**

From BERT, Fast-Text, Dynamic-Memory Network, Sparse Tensorflow, Attention Neural Network to build deep sentiment analysis models.
- **Spell Correction**

Using local Malaysia NLP researches to auto-correct any bahasa words.
- Stemmer
- **Subjectivity Analysis**

From BERT, Fast-Text, Dynamic-Memory Network, Sparse Tensorflow, Attention Neural Network to build deep subjectivity analysis models.
- **Summarization**

Using skip-thought with attention state-of-art to give precise unsupervised summarization.
- **Topic Modelling**

Provide LDA2Vec, LDA, NMF and LSA interface for easy topic modelling with topics visualization.
- **Toxicity Analysis**

From BERT, Fast-Text, Dynamic-Memory Network, Attention Neural Network to build deep toxicity analysis models.
- **Word2Vec**

Provide pretrained bahasa wikipedia and bahasa news Word2Vec, with easy interface and visualization.
- **Fast-text**

Provide pretrained bahasa wikipedia Fast-text, with easy interface and visualization.

License
--------

.. |License| image:: https://app.fossa.io/api/projects/git%2Bgithub.com%2Fhuseinzol05%2FMalaya.svg?type=large
:target: https://app.fossa.io/projects/git%2Bgithub.com%2Fhuseinzol05%2FMalaya?ref=badge_large

|License|


Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

malaya-1.9.1.1.tar.gz (1.4 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

malaya-1.9.1.1-py3-none-any.whl (1.5 MB view details)

Uploaded Python 3

File details

Details for the file malaya-1.9.1.1.tar.gz.

File metadata

  • Download URL: malaya-1.9.1.1.tar.gz
  • Upload date:
  • Size: 1.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for malaya-1.9.1.1.tar.gz
Algorithm Hash digest
SHA256 cb6ef1c03d3ac5351832279f587d6ef54e27746b078a2d23894b0e721d8db39f
MD5 43d9ecf6ea12b4251e1e6d022680f89e
BLAKE2b-256 3732ae503449f585e619b1ee40d391232aa2a59a666d9ccbe765eb2ba7fc193f

See more details on using hashes here.

File details

Details for the file malaya-1.9.1.1-py3-none-any.whl.

File metadata

  • Download URL: malaya-1.9.1.1-py3-none-any.whl
  • Upload date:
  • Size: 1.5 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for malaya-1.9.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c62771a1525af44b4f2418bad8af512bb509e0b5e6e064e31a7e4e24402f54a0
MD5 1015945edc6a3bedfbb31c7d9107564b
BLAKE2b-256 e3f41cfeb42b0c3bd23d3dd47d62f47d867dc566bdcb3c5e7909a484e3c38689

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page