A lightweight utility for preprocessing and cleaning social media text (slang, emojis, hashtags, etc.).
Project description
SocialPreText
A simple, lightweight Python utility for preprocessing and cleaning social media text.
socialpretext cleans raw text by expanding slang, expanding contractions, removing emojis, URLs, hashtags, and more, making it ready for NLP models and analysis.
Features
- Expand common slang (e.g.,
idk->I do not know) - Expand English contractions (e.g.,
don't->do not) - Remove or "demojize" emojis (e.g.,
😊->:smiling_face:) - Remove URLs
- Remove user mentions (
@mentions) - Remove hashtags (
#hashtags) - Normalize whitespace
Installation
pip install socialpretext
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
socialpretext-0.1.0.tar.gz
(5.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file
socialpretext-0.1.0.tar.gz.File metadata
File hashes
22d655a16e441eccd5dcad20cf3d8bb00a7e0614f2c27efeb291d9dd4e31f8d02118b11617f4915603ffd27b34669755b480d497e9cc2f41bc2b3900bd85b0ae18979baefdd50e433a8d4b28117af424See more details on using hashes here.