Skip to main content

Nlpcleaner Build Status

Clean and prepare text for modeling with machine learning.

  • lower all
  • strip all
  • remove numbers
  • remove symbols
  • remove url
  • strip html tags
  • remove stopwords by detected language or passed language
  • lemming or stemming

Usage

from nlpcleaner import TextCleaner
TextCleaner(txt).clean()

Tests

pipenv install .
python setup.py test

Push on PyPi

python setup.py sdist
pip install twine
twine upload dist/*

TODO

  • Add tests to cover different cases and languages;
  • check performances

Metadata

Release files for nlpcleaner 0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for nlpcleaner 0.3.1
File Size Uploaded Provenance
nlpcleaner-0.3.1.tar.gz 17.5 MB Without provenance Details

Release files / nlpcleaner-0.3.1.tar.gz

Download URL nlpcleaner-0.3.1.tar.gz
Size 17.5 MB
Tags Source
SHA-256 checksum
How to use checksums
268aa5ef03b1a4e09b22523e2bd25ac26cdbd142252a76034e77a05398845fc2
BLAKE2b-256 checksum
How to use checksums
979856e2e5e62b4f7e2f6e1199487646f091696c4f8d13d63d86d0aa1543b910
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.40.2 CPython/3.7.5

Security for nlpcleaner 0.3.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page