PyShbak 0.3

SHAWPACK NLP processing package

PyShbak

Now with PyShbak, dealing with Arabic texts has become easy, and in the future it will become easier with PyShbak

Installation

pip3 install PyShbak

---

Structure

|> PyShbak

| ------> | Normalization

|---------| ------> | Normalization_ar

|---------|---------| ------> | alef

|---------|---------| ------> | lamalef

|---------|---------| ------> | hamza

|---------|---------| ------> | tah

|---------|---------| ------> | madah

|---------|---------| ------> | normalization_all

| ------> Processor

|---------| ------> | Arabic_Processor

|---------|---------| ------> | remove_stopword

|---------|---------| ------> | remove_other_lang

|---------|---------| ------> | remove_diacritics

|---------|---------| ------> | remove_arabic_punctuations

|---------|---------| ------> | arabic_only

|---------|---------| ------> | with_out_num

|---------| ------> | English_Processor

|---------|---------| ------> | remove_stopword

|---------|---------| ------> | english_only

|---------|---------| ------> | remove_english_punctuations

|---------|---------| ------> | with_out_num

|---------| ------> | General_Processor

|---------|---------| ------> | remove_mentions

|---------|---------| ------> | remove_hasgtag

|---------|---------| ------> | remove_links

|---------|---------| ------> | remove_punctation

|---------|---------| ------> | keep_text

|---------|---------| ------> | remove_emojis

|---------|---------| ------> | remove_whitespace

|---------| ------> | cleaningtext

|---------|---------| ------> | delete_repeated_characters

|---------|---------| ------> | replace_letters

|---------|---------| ------> | clean_text

|---------|---------| ------> | remove_vowelization

|---------|---------| ------> | remove_stopword

|---------|---------| ------> | stem_text

|---------|---------| ------> | text_prepare

---

Example:

pip3 install PyShbak

from PyShbak.TweetsCleaner import Clean_tweet

text = 'akhhh !تَوقَعْت إذا جات داريا بشوفهم كاملين بس لي للحين احس فيه احد ناقْصهم 💔 #Avlu https://www.messenger.com/ @PyShbak '

Clean_tweet.ar(text)

output: ' توقعت اذا جات داريا بشوفهم كاملين بس لي للحين احس فيه احد ناقصهم '