TextPreProcessing
Python package for preprocessing text for NLP models
INSTALLATION
$ pip install text-ppf
To upgrade:
$ pip install text-ppf --upgrade
WHAT IT DOES
An all-in-one function which,
- Removes punctuation
- Splits the text into a list of words
- Removes stopwords
- Makes each word lowercase
- Lemmatizes each word
USAGE
text_ppf
import pandas as pd
from text_ppf import text_ppf
#LOADING DATASET
df = pd.read_csv('filename.csv')
# print(df.head)
dfNew = df['heading'].apply(text_ppf.clean_up)
print(dfNew)
Release files for text-ppf 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| text_ppf-1.0.0.tar.gz | 2.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| text_ppf-1.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 6.0 kB
Release files / text_ppf-1.0.0.tar.gz
| Download URL | text_ppf-1.0.0.tar.gz |
|---|---|
| Size | 2.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a70a5e57b7a7e1de622a7b22844e1e33a4065d152ca050544b65b4959ef4bdf1
|
|
BLAKE2b-256 checksum How to use checksums |
2295abc87711eec83990703422e69ea299ca8afd0101ae030518cc44ff6876e2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/3.10.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.49.0 CPython/3.9.4
|
Release files / text_ppf-1.0.0-py3-none-any.whl
| Download URL | text_ppf-1.0.0-py3-none-any.whl |
|---|---|
| Size | 3.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
50410f945a7d7778336c94db95bf7b998f01789f66d0c253161fd1e99ed03825
|
|
BLAKE2b-256 checksum How to use checksums |
ccbc6eae24144aa0efa928d94b960088433b2547dddc9edc7fdcc9250928fd75
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/3.10.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.49.0 CPython/3.9.4
|