Skip to main content

text_cleaner

A Python package for cleaning and tokenizing text.

Features

  • Remove punctuation
  • Lowercase text
  • Filter basic stop words

Usage

from text_cleaner import clean_text

text = "The quick, brown fox jumps over the lazy dog!"
print(clean_text(text))
# Output: ['quick', 'brown', 'fox', 'jumps', 'over', 'lazy', 'dog']

Metadata

Release files for text-cleaner-yuvan 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for text-cleaner-yuvan 0.1.0
File Size Uploaded
text_cleaner_yuvan-0.1.0.tar.gz 2.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for text-cleaner-yuvan 0.1.0
File Interpreter ABI Platform
text_cleaner_yuvan-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 4.5 kB

Release files / text_cleaner_yuvan-0.1.0.tar.gz

Download URL text_cleaner_yuvan-0.1.0.tar.gz
Size 2.1 kB
Tags Source
SHA-256 checksum
How to use checksums
c483a4d5c537480428dad8b9e401a306000ba9d8991a236c6ec00ce3ad01bf08
BLAKE2b-256 checksum
How to use checksums
e1cfef7fa81e09f580d684c479d0aa55f7620e6927ce6b2a23aa2dbe31b4ccad
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.10

Release files / text_cleaner_yuvan-0.1.0-py3-none-any.whl

Download URL text_cleaner_yuvan-0.1.0-py3-none-any.whl
Size 2.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1a09be8709384ce4ca6e6869b45ca3a62c17b2835ee740257373e13fa9769068
BLAKE2b-256 checksum
How to use checksums
02b2493e497bea0d2b3b1e99ccbb9ec9dea4f9cf153de371b29f44a98a7537f3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.10

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page