distilNLP
distilNLP is a low-dependency, GPU-free natural language processing toolkit designed for building natural language processing applications and preprocessing for deep learning.
Install
pip install -U distilNLP
Usage
Text Normalize
Text normalization processing. Correct common character errors in text from the internet.
from distilnlp import text_normalize
norm = text_normalize('Proposed programme budget for the biennium 2006-2007： Section 29， Office of Internal Oversight Services。 ', lang='en')
# got: 'Proposed programme budget for the biennium 2006-2007: Section 29, Office of Internal Oversight Services。'
norm = text_normalize(' 2006-2007两年期拟议方案预算:😇第29款,内部监督事务厅.', lang='zh')
# got: '2006-2007两年期拟议方案预算：第29款，内部监督事务厅。'
norm = text_normalize('百度的网址是: http：//baidu.com', lang='zh')
# got: '百度的网址是： http://baidu.com'
1 maintainer
Metadata
1 maintainer
Release files for distilNLP 0.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| distilNLP-0.0.6.tar.gz | 58.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| distilNLP-0.0.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 119.2 kB
Release files / distilNLP-0.0.6.tar.gz
| Download URL | distilNLP-0.0.6.tar.gz |
|---|---|
| Size | 58.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
dc330d4b95db7e0ad19024f54e5ab6c06814851f619b43885d7f9003ba29fea2
|
|
BLAKE2b-256 checksum How to use checksums |
48b09ea9f39ce13af49f8941d3a9f3ba07ab73e403e6fd04175bb66f87cc3e8b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.2
|
Release files / distilNLP-0.0.6-py3-none-any.whl
| Download URL | distilNLP-0.0.6-py3-none-any.whl |
|---|---|
| Size | 60.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
bab6f0805a9474c4730d6d1facf474f10ff35904a4c620e7bdc32977db320ada
|
|
BLAKE2b-256 checksum How to use checksums |
2d2dfaaf283cb0897ed70b9c11c197df9984f7acbb6a20885bf364248e751578
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.2
|
