Skip to main content

Preprocess YourText

Preprocess YourText is a Python package for text preprocessing tasks, designed to simplify and streamline the process of cleaning and preparing text data for natural language processing (NLP) tasks.

Features

  • HTML Tag Removal: Easily remove HTML tags from text data.
  • URL Removal: Remove URLs from text data.
  • Email Removal: Remove email addresses from text data.
  • Special Character Removal: Remove special characters from text data.
  • Accent Removal: Remove accents from characters in text data.
  • Contractions Expansion: Expand contractions in text data (e.g., "don't" to "do not").
  • Lemmatization: Lemmatize words in text data to their base form.
  • Spelling Correction: Correct spelling mistakes in text data.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Installation

You can install the package via pip:

pip install mngdataclean

## Usage
import mngdataclean as mdc

# Example usage:
text = "This is an example text with HTML tags <b>and URLs</b>."
clean_text = mdc.get_clean(text)
print(clean_text)

#output is 
This is an example text with HTML tags and URLs.

Metadata

Release files for mngdataclean 0.4.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mngdataclean 0.4.2
File Size Uploaded
mngdataclean-0.4.2.tar.gz 3.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for mngdataclean 0.4.2
File Interpreter ABI Platform
mngdataclean-0.4.2-py3-none-any.whl Python 3 none any Details

Total release size: 6.9 kB

Release files / mngdataclean-0.4.2.tar.gz

Download URL mngdataclean-0.4.2.tar.gz
Size 3.3 kB
Tags Source
SHA-256 checksum
How to use checksums
b0a30fcadf1a1669f2a9f23295abcc7eef177eaa343bca4897da8d4bd40f4e57
BLAKE2b-256 checksum
How to use checksums
1d363abc07be11c27d744de165d982d9a21395db0b7639fa8cc2858417828a8d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.10.4

Release files / mngdataclean-0.4.2-py3-none-any.whl

Download URL mngdataclean-0.4.2-py3-none-any.whl
Size 3.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9d9b694c4e4bf8b851a4e589fd7ce1918ead7f3bc2562f5de26b785729aff000
BLAKE2b-256 checksum
How to use checksums
fdaab9f62a3066d2fca6398412c82753f6ae4b65fe3900f77b598ab51b109608
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.0.0 CPython/3.10.4

Release history Release notifications | RSS feed

This release

0.4.2 This release

2 release files

0.4.1

2 release files

0.4

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page