Text preprocessing package
Project description
Preprocess YourText
Preprocess YourText is a Python package for text preprocessing tasks, designed to simplify and streamline the process of cleaning and preparing text data for natural language processing (NLP) tasks.
Features
- HTML Tag Removal: Easily remove HTML tags from text data.
- URL Removal: Remove URLs from text data.
- Email Removal: Remove email addresses from text data.
- Special Character Removal: Remove special characters from text data.
- Accent Removal: Remove accents from characters in text data.
- Contractions Expansion: Expand contractions in text data (e.g., "don't" to "do not").
- Lemmatization: Lemmatize words in text data to their base form.
- Spelling Correction: Correct spelling mistakes in text data.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Installation
You can install the package via pip:
pip install mngdataclean
## Usage
import mngdataclean as mdc
# Example usage:
text = "This is an example text with HTML tags <b>and URLs</b>."
clean_text = mdc.get_clean(text)
print(clean_text)
#output is
This is an example text with HTML tags and URLs.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mngdataclean-0.4.tar.gz
(3.2 kB
view hashes)
Built Distribution
Close
Hashes for mngdataclean-0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8faef902538fb337d9e935f407c53e272638ef129d20b0d6d53f6361da4f8636 |
|
MD5 | f1bce5d02446b1055183b8d4d7f3a46c |
|
BLAKE2b-256 | dfbe701787b76f4768152ba3fcf10f877d229f061f3d96a060af3524dd206a29 |