Skip to main content

Tiny NLP preprocessing helpers (tokenize, normalize, remove_stopwords).

Project description

i054_pypi_preprocess

Small, dependency-free NLP preprocessing utilities:

  • normalize_text(text)
  • remove_punct(text)
  • tokenize_simple(text)
  • remove_stopwords(tokens[, stopwords])
  • preprocess(text[, stopwords])

Install

pip install i054_pypi_preprocess

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

i054_pypi_preprocess-0.1.0.tar.gz (3.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

i054_pypi_preprocess-0.1.0-py3-none-any.whl (3.4 kB view details)

Uploaded Python 3

File details

Details for the file i054_pypi_preprocess-0.1.0.tar.gz.

File metadata

  • Download URL: i054_pypi_preprocess-0.1.0.tar.gz
  • Upload date:
  • Size: 3.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for i054_pypi_preprocess-0.1.0.tar.gz
Algorithm Hash digest
SHA256 551b531e9eaaef0c7bbc211f31c052941fb7332854bce7660cd37804b487b942
MD5 ee641c9e847899617f1c62c53fb5dd54
BLAKE2b-256 784d5fe05d0ece659b12f4de30cf690f4bc543e8c57cc135de6f28528597f5cc

See more details on using hashes here.

File details

Details for the file i054_pypi_preprocess-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for i054_pypi_preprocess-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 10c32deb305ea837b549bf8e7b9d7418b199199460c6397967a77fedccd65f16
MD5 afd52210f49e9928a10b0a1e7c7e9597
BLAKE2b-256 8111c53c78511108c4aa9b34e860434b3ea7c7b76bc5b2a7ea7ca859f356e824

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page