Skip to main content

TextPreProcessing

Python package for preprocessing text for NLP models

INSTALLATION

Download PyPi Package , or

$ pip install text-ppf

To upgrade:

$ pip install text-ppf --upgrade

WHAT IT DOES

An all-in-one function which,

  • Removes punctuation
  • Splits the text into a list of words
  • Removes stopwords
  • Makes each word lowercase
  • Lemmatizes each word

USAGE

text_ppf

import pandas as pd
from text_ppf import text_ppf

#LOADING DATASET
df = pd.read_csv('filename.csv')
# print(df.head)

dfNew = df['heading'].apply(text_ppf.clean_up)
print(dfNew)

Release files for text-ppf 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for text-ppf 1.0.0
File Size Uploaded
text_ppf-1.0.0.tar.gz 2.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for text-ppf 1.0.0
File Interpreter ABI Platform
text_ppf-1.0.0-py3-none-any.whl Python 3 none any Details

Total release size: 6.0 kB

Release files / text_ppf-1.0.0.tar.gz

Download URL text_ppf-1.0.0.tar.gz
Size 2.9 kB
Tags Source
SHA-256 checksum
How to use checksums
a70a5e57b7a7e1de622a7b22844e1e33a4065d152ca050544b65b4959ef4bdf1
BLAKE2b-256 checksum
How to use checksums
2295abc87711eec83990703422e69ea299ca8afd0101ae030518cc44ff6876e2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/3.10.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.49.0 CPython/3.9.4

Release files / text_ppf-1.0.0-py3-none-any.whl

Download URL text_ppf-1.0.0-py3-none-any.whl
Size 3.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
50410f945a7d7778336c94db95bf7b998f01789f66d0c253161fd1e99ed03825
BLAKE2b-256 checksum
How to use checksums
ccbc6eae24144aa0efa928d94b960088433b2547dddc9edc7fdcc9250928fd75
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/3.10.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.49.0 CPython/3.9.4

Release history Release notifications | RSS feed

This release

1.0.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page