Wrapper library for data cleansing, preprocessing in text
Project description
Maleo
Wrapper library for text cleansing, preprocessing in NLP
Overview of features
- Scanner : get insight about your text dataset (ex: number of chars, words, emojis, etc)
- Remove hyperlink, punctuation, stopword, emoticon, etc
- Extract hashtags, price from text
- Convert email, phone number, date to <TAG>
- Convert Indonesian slang to formal word
- Convert emoji to word
- Convert word to number
Installation
pip install maleo
Getting Started
from maleo.wizard import Wizard
wiz = Wizard()
wiz.scanner(df, 'text')
wiz.emoji_to_word(df.text)
wiz.slang_to_formal(df.text)
Instance Attribute
['scanner',
'rm_multiple_space',
'rm_link',
'rm_punc',
'rm_char',
'rm_html',
'rm_non_ascii',
'rm_stopword',
'rm_emoticon',
'word_to_number',
'get_hashtag',
'get_price',
'email_to_tag',
'date_to_tag',
'phone_num_to_tag',
'slang_to_formal',
'emoji_to_word']
Contributor:
- Ruben Stefanus
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
maleo-0.0.5.tar.gz
(71.4 kB
view hashes)