Yoctol Natural Language Text Normalizer
Project description
# text-normalizer
[![travis][travis-image]][travis-url]
[![pypi][pypi-image]][pypi-url]
[travis-image]: https://img.shields.io/travis/Yoctol/text-normalizer.svg?style=flat
[travis-url]: https://travis-ci.org/Yoctol/text-normalizer
[pypi-image]: https://img.shields.io/pypi/v/text-normalizer.svg?style=flat
[pypi-url]: https://pypi.python.org/pypi/text-normalizer
Normalize your Text String.
It is a python package that help you normalize your text data and recover it.
## Install
Use Python3
```
> pip install text-normalizer
```
## Usage
```python
from text_normalizer.text_normalizer_collection_library import chinese_charactor_text_normalizer_collection_2
input_sentence = " 我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m"
nor_sentence, meta = chinese_charactor_text_normalizer_collection_2.normalize(input_sentence)
print(nor_sentence)
> "我在_float_度c買了一杯_int_-_int_元的咖啡 <ohoh>?? m_m"
de_sentence = chinese_charactor_text_normalizer_collection_2.denormalize(nor_sentence, meta)
print(de_sentence)
> "我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m",
```
[![travis][travis-image]][travis-url]
[![pypi][pypi-image]][pypi-url]
[travis-image]: https://img.shields.io/travis/Yoctol/text-normalizer.svg?style=flat
[travis-url]: https://travis-ci.org/Yoctol/text-normalizer
[pypi-image]: https://img.shields.io/pypi/v/text-normalizer.svg?style=flat
[pypi-url]: https://pypi.python.org/pypi/text-normalizer
Normalize your Text String.
It is a python package that help you normalize your text data and recover it.
## Install
Use Python3
```
> pip install text-normalizer
```
## Usage
```python
from text_normalizer.text_normalizer_collection_library import chinese_charactor_text_normalizer_collection_2
input_sentence = " 我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m"
nor_sentence, meta = chinese_charactor_text_normalizer_collection_2.normalize(input_sentence)
print(nor_sentence)
> "我在_float_度c買了一杯_int_-_int_元的咖啡 <ohoh>?? m_m"
de_sentence = chinese_charactor_text_normalizer_collection_2.denormalize(nor_sentence, meta)
print(de_sentence)
> "我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m",
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
text-normalizer-0.1.0.tar.gz
(25.2 kB
view hashes)
Built Distribution
Close
Hashes for text_normalizer-0.1.0-py3.6-linux-x86_64.egg
Algorithm | Hash digest | |
---|---|---|
SHA256 | 294198422948112020ceb51a6520095ed138185ad415eabb465d99ea0ecbc7b1 |
|
MD5 | 2bbb34c97aecb3b697d3dc8b751acc17 |
|
BLAKE2b-256 | f4f8079067fa7d25f3b0f333d5c02012f92bd4b2f8cfa3d2d3c063efdf4d9a58 |