distilNLP is a low-dependency, GPU-free natural language processing toolkit.
Project description
distilNLP
distilNLP is a low-dependency, GPU-free natural language processing toolkit designed for building natural language processing applications and preprocessing for deep learning.
Install
pip install -U distilNLP
Usage
Text Normalize
Text normalization processing. Correct common character errors in text from the internet.
from distilnlp import text_normalize
norm = text_normalize('Proposed programme budget for the biennium 2006-2007： Section 29， Office of Internal Oversight Services。 ', lang='en')
# got: 'Proposed programme budget for the biennium 2006-2007: Section 29, Office of Internal Oversight Services。'
norm = text_normalize(' 2006-2007两年期拟议方案预算:😇第29款,内部监督事务厅.', lang='zh')
# got: '2006-2007两年期拟议方案预算：第29款，内部监督事务厅。'
norm = text_normalize('百度的网址是: http：//baidu.com', lang='zh')
# got: '百度的网址是： http://baidu.com'
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file distilNLP-0.0.6.tar.gz.
File metadata
- Download URL: distilNLP-0.0.6.tar.gz
- Upload date:
- Size: 58.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dc330d4b95db7e0ad19024f54e5ab6c06814851f619b43885d7f9003ba29fea2
|
|
| MD5 |
20cf4045b0e3b537822ccdeabfe66b89
|
|
| BLAKE2b-256 |
48b09ea9f39ce13af49f8941d3a9f3ba07ab73e403e6fd04175bb66f87cc3e8b
|
File details
Details for the file distilNLP-0.0.6-py3-none-any.whl.
File metadata
- Download URL: distilNLP-0.0.6-py3-none-any.whl
- Upload date:
- Size: 60.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bab6f0805a9474c4730d6d1facf474f10ff35904a4c620e7bdc32977db320ada
|
|
| MD5 |
3dbfcbae9ae56701f2c7aba23bb7dcd0
|
|
| BLAKE2b-256 |
2d2dfaaf283cb0897ed70b9c11c197df9984f7acbb6a20885bf364248e751578
|
