maleo 0.0.3

Wrapper library for data cleansing, preprocessing in text

Maleo

Wrapper library for text cleansing, preprocessing in NLP

Overview of features

- Scanner : get insight about your text dataset (ex: number of chars, words, emojis, etc)
- Remove hyperlink, punctuation, stopword, emoticon, etc
- Extract hashtags, price from text
- Convert email, phone number, date to <TAG>
- Convert Indonesian slang to formal word
- Convert emoji to word
- Convert word to number

Installation

pip install maleo

Getting Started

from maleo.wizard import Wizard

wiz = Wizard()

wiz.scanner(df, 'text')
wiz.emoji_to_word(df.text)
wiz.slang_to_formal(df.text)

Instance Attribute

['scanner',
 'rm_multiple_space',
 'rm_link',
 'rm_punc',
 'rm_char',
 'rm_html',
 'rm_non_ascii',
 'rm_stopword',
 'rm_emoticon',
 'word_to_number',
 'get_hashtag',
 'get_price',
 'email_to_tag',
 'date_to_tag',
 'phone_num_to_tag',
 'slang_to_formal',
 'emoji_to_word']

Contributor:

• Ruben Stefanus