neattext 0.0.2

Neattext - a simple NLP package for cleaning text

neattext

NeatText:a simple NLP package for cleaning textual data and text preprocessing

Problem

• Cleaning of unstructured text data
• Reduce noise [special characters,stopwords]
• Reducing repetition of using the same code for text preprocessing

Solution

• convert the already known solution for cleaning text into a reuseable package

Installation

pip install neattext

Usage

• The OOP Way(Object Oriented Way)

Clean Text

• Clean text by removing emails,numbers,stopwords,emojis,etc

>>> from neattext import TextCleaner
>>> docx = TextCleaner()
>>> docx.text = "This is the mail [e-mail] ,our WEBSITE is https://example.com 😊."
>>> docx.clean_text()

Remove Emails,Numbers,Phone Numbers

>>> docx.remove_emails()
>>> 'This is the mail  ,our WEBSITE is https://example.com 😊.'
>>>
>>> docx.remove_stopwords()
>>> 'This mail [e-mail] ,our WEBSITE https://example.com 😊.'
>>>
>>> docx.remove_numbers()
>>> docx.remove_phone_numbers()

Remove Special Characters

>>> docx.remove_special_characters()

Remove Emojis

>>> docx.remove_emojis()
>>> 'This is the mail [e-mail] ,our WEBSITE is https://example.com .'

Replace Emails,Numbers,Phone Numbers

>>> docx.replace_emails()
>>> docx.replace_numbers()
>>> docx.replace_phone_numbers()

Using TextExtractor

• To Extract emails,phone numbers,numbers,urls,emojis from text

>>> from neattext import TextExtractor
>>> docx = TextExtractor()
>>> docx.text = "This is the mail [e-mail] ,our WEBSITE is https://example.com 😊."
>>> docx.extract_emails()
>>> ['[e-mail]']
>>>
>>> docx.extract_emojis()
>>> ['😊']

Using TextMetrics

• To Find the Words Stats such as counts of vowels,consonants,stopwords,word-stats

>>> from neattext import TextMetrics
>>> docx = TextMetrics()
>>> docx.text = "This is the mail [e-mail] ,our WEBSITE is https://example.com 😊."
>>> docx.count_vowels()
>>> docx.count_consonants()
>>> docx.count_stopwords()
>>> docx.word_stats()

Usage

• The MOP(method/function oriented way) Way

>>> from neattext.neattext import clean_text,extract_emails
>>> t1 = "This is the mail [e-mail] ,our WEBSITE is https://example.com ."
>>> clean_text(t1,True)
>>>'this is the mail <email> ,our website is <url> .'
>>> extract_emails(t1)
>>> ['[e-mail]']

Documentation

Please read the documentation for more information on what neattext does and how to use is for your needs.

More Features To Add

• unicode explainer
• currency normalizer

Acknowledgements

• Inspired by packages like clean-text from Johannes Fillter and textify by JCharisTech

NB

• Contributions Are Welcomed
• Notice a bug, please let us know.
• Thanks A lot

By

• Jesse E.Agbe(JCharis)
• Jesus Saves @JCharisTech