Skip to main content

Nlpcleaner Build Status

Clean and prepare text for modeling with machine learning.

  • lower all
  • strip all
  • remove numbers
  • remove symbols
  • remove url
  • strip html tags
  • remove stopwords by detected language or passed language
  • lemming or stemming

Usage

from nlpcleaner import TextCleaner
TextCleaner(txt).clean()

Tests

pipenv install .
python setup.py test

Push on PyPi

python setup.py sdist
pip install twine
twine upload dist/*

TODO

  • Add tests to cover different cases and languages;
  • check performances

Release files for nlpcleaner 0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for nlpcleaner 0.3.1
File Size Uploaded
nlpcleaner-0.3.1.tar.gz 17.5 MB Details

Release files / nlpcleaner-0.3.1.tar.gz

Download URL nlpcleaner-0.3.1.tar.gz
Size 17.5 MB
Tags Source
SHA-256 checksum
How to use checksums
268aa5ef03b1a4e09b22523e2bd25ac26cdbd142252a76034e77a05398845fc2
BLAKE2b-256 checksum
How to use checksums
979856e2e5e62b4f7e2f6e1199487646f091696c4f8d13d63d86d0aa1543b910
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.40.2 CPython/3.7.5

Release history Release notifications | RSS feed

This release

0.3.1 This release

1 release file

0.3.0

1 release file

0.2.1

1 release file

0.2.0

1 release file

0.1.9

1 release file

0.1.8

1 release file

0.1.7

1 release file

0.1.6

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page