Text preprocessing package
Project description
Preprocess YourText
Preprocess YourText is a Python package for text preprocessing tasks, designed to simplify and streamline the process of cleaning and preparing text data for natural language processing (NLP) tasks.
Features
- HTML Tag Removal: Easily remove HTML tags from text data.
- URL Removal: Remove URLs from text data.
- Email Removal: Remove email addresses from text data.
- Special Character Removal: Remove special characters from text data.
- Accent Removal: Remove accents from characters in text data.
- Contractions Expansion: Expand contractions in text data (e.g., "don't" to "do not").
- Lemmatization: Lemmatize words in text data to their base form.
- Spelling Correction: Correct spelling mistakes in text data.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Installation
You can install the package via pip:
pip install mngdataclean
## Usage
import mngdataclean as mdc
# Example usage:
text = "This is an example text with HTML tags <b>and URLs</b>."
clean_text = mdc.get_clean(text)
print(clean_text)
#output is
This is an example text with HTML tags and URLs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mngdataclean-0.4.1.tar.gz
(3.4 kB
view hashes)
Built Distribution
Close
Hashes for mngdataclean-0.4.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a0afbc59c6f1880410db5669346005ef1b3f31ff8f8a467eb6997f7f599b05a6 |
|
MD5 | 920d3318f3923c886a78f95c94007b17 |
|
BLAKE2b-256 | d6c3c0307619c6137a808af26c69b2725cc7e60a424ebc2a138869349cb658d3 |