Skip to main content

A simple text cleaning tool for NLP.

Project description

text_cleaner

A Python package for cleaning and tokenizing text.

Features

  • Remove punctuation
  • Lowercase text
  • Filter basic stop words

Usage

from text_cleaner import clean_text

text = "The quick, brown fox jumps over the lazy dog!"
print(clean_text(text))
# Output: ['quick', 'brown', 'fox', 'jumps', 'over', 'lazy', 'dog']

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

text_cleaner_yuvan-0.1.0.tar.gz (2.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

text_cleaner_yuvan-0.1.0-py3-none-any.whl (2.4 kB view details)

Uploaded Python 3

File details

Details for the file text_cleaner_yuvan-0.1.0.tar.gz.

File metadata

  • Download URL: text_cleaner_yuvan-0.1.0.tar.gz
  • Upload date:
  • Size: 2.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for text_cleaner_yuvan-0.1.0.tar.gz
Algorithm Hash digest
SHA256 c483a4d5c537480428dad8b9e401a306000ba9d8991a236c6ec00ce3ad01bf08
MD5 89786d295fc94f06dbd760325038ca39
BLAKE2b-256 e1cfef7fa81e09f580d684c479d0aa55f7620e6927ce6b2a23aa2dbe31b4ccad

See more details on using hashes here.

File details

Details for the file text_cleaner_yuvan-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for text_cleaner_yuvan-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1a09be8709384ce4ca6e6869b45ca3a62c17b2835ee740257373e13fa9769068
MD5 f38c16b30086a8cbdc00af22c7dbf64f
BLAKE2b-256 02b2493e497bea0d2b3b1e99ccbb9ec9dea4f9cf153de371b29f44a98a7537f3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page