Skip to main content

Preprocessing Library for Natural Language Processing

Project description

PreNLP

Preprocessing Library for Natural Language Processing

Installation

pip install prenlp

Usage

Data

Normalization

from prenlp.data.normalization import *

>>> url_normalize('Visit this link for more details: https://github.com/', repl='[URL]')
Visit this link for more details: [URL]

>>> tag_normalize('Use HTML with the desired attributes: <img src="cat.jpg" height="100" />', repl='[TAG]')
Use HTML with the desired attributes: [TAG]

>>> emoji_normalize('Hello 🤩, I love you 💓 !', repl='[EMOJI]')
Hello [EMOJI], I love you [EMOJI] !

>>> email_normalize('Contact me at lyeoni.g@gmail.com', repl='[EMAIL]')
Contact me at [EMAIL]

>>> tel_normalize('Call +82 10-1234-5678', repl='[TEL]')
Call [TEL]

Author

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

prenlp-0.0.3-py3-none-any.whl (18.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page