A short description of the package
Project description
TextPreprocessor
TextPreprocessor is a Python package for advanced text preprocessing. It provides various methods for cleaning, normalizing, and tokenizing text data. The package relies on the spaCy library for natural language processing tasks.
Features
- Text Cleaning: Remove HTML tags, special characters, and extra whitespaces.
- Lowercasing: Convert text to lowercase.
- Tokenization: Tokenize text into words and sentences.
- Stop Words Removal: Remove common stop words from tokenized text.
- Normalization: Lemmatize tokens to their base forms.
- Punctuation Handling: Remove punctuation from text.
- Number Removal: Remove numerical digits from text.
Installation
To use the TextPreprocessor package, you need to install both the package and its dependencies. You can do this using pip:
pip install textpreprocessor
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file text_processor_nlp-0.1.tar.gz.
File metadata
- Download URL: text_processor_nlp-0.1.tar.gz
- Upload date:
- Size: 2.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0e494e781ca5ec099606586875bd1dfb5a7d42a498b07b1fe659565128a7beef
|
|
| MD5 |
4f4271af3f8d124d15718944894b687e
|
|
| BLAKE2b-256 |
2e30f1d8591b48f355b3692309cbde72f73abb2b695723ca32aee2638b3e2e28
|
File details
Details for the file text_processor_nlp-0.1-py3-none-any.whl.
File metadata
- Download URL: text_processor_nlp-0.1-py3-none-any.whl
- Upload date:
- Size: 2.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
be650f80e5895934682a060e6aa717637e75851d5feea3ac93332ea76d5ce159
|
|
| MD5 |
4f53cf3b287fc44b3a285e17bcb37cb8
|
|
| BLAKE2b-256 |
b8fb4e18d68ba45543256f5a3e975a25e7147d0222d22006a30983a608e56602
|
