Skip to main content

Yoctol Natural Language Text Normalizer

Project description

# text-normalizer

[![travis][travis-image]][travis-url]
[![pypi][pypi-image]][pypi-url]

[travis-image]: https://img.shields.io/travis/Yoctol/text-normalizer.svg?style=flat
[travis-url]: https://travis-ci.org/Yoctol/text-normalizer
[pypi-image]: https://img.shields.io/pypi/v/text-normalizer.svg?style=flat
[pypi-url]: https://pypi.python.org/pypi/text-normalizer

Normalize your Text String.
It is a python package that help you normalize your text data and recover it.

## Install
Use Python3
```
> pip install text-normalizer
```
## Usage
```python
from text_normalizer.text_normalizer_collection_library import chinese_charactor_text_normalizer_collection_2


input_sentence = " 我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m"
nor_sentence, meta = chinese_charactor_text_normalizer_collection_2.normalize(input_sentence)
print(nor_sentence)
> "我在_float_度c買了一杯_int_-_int_元的咖啡 <ohoh>?? m_m"

de_sentence = chinese_charactor_text_normalizer_collection_2.denormalize(nor_sentence, meta)
print(de_sentence)
> "我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m",

```

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

text-normalizer-0.1.0.tar.gz (25.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

text_normalizer-0.1.0-py3.6-linux-x86_64.egg (218.9 kB view details)

Uploaded Egg

File details

Details for the file text-normalizer-0.1.0.tar.gz.

File metadata

  • Download URL: text-normalizer-0.1.0.tar.gz
  • Upload date:
  • Size: 25.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.0 setuptools/40.5.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.2

File hashes

Hashes for text-normalizer-0.1.0.tar.gz
Algorithm Hash digest
SHA256 b52b56a9b20405f8219edd730f9c92a36761a246ae6da4c2a4da540fed9b9a31
MD5 a2d5542fcc0e808b7d7eade9cc6d2690
BLAKE2b-256 2823de4bcb116c33e7eb1c8f7d8fa8f795f4dfa467ddf6e0eebc48baffba2e38

See more details on using hashes here.

File details

Details for the file text_normalizer-0.1.0-py3.6-linux-x86_64.egg.

File metadata

  • Download URL: text_normalizer-0.1.0-py3.6-linux-x86_64.egg
  • Upload date:
  • Size: 218.9 kB
  • Tags: Egg
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.0 setuptools/40.5.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.2

File hashes

Hashes for text_normalizer-0.1.0-py3.6-linux-x86_64.egg
Algorithm Hash digest
SHA256 294198422948112020ceb51a6520095ed138185ad415eabb465d99ea0ecbc7b1
MD5 2bbb34c97aecb3b697d3dc8b751acc17
BLAKE2b-256 f4f8079067fa7d25f3b0f333d5c02012f92bd4b2f8cfa3d2d3c063efdf4d9a58

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page