Light-weight tool for normalizing whitespace and accurately tokenizing words (no regex). Multiple natural languages supported.
Project description
Light-weight tool for normalizing whitespace and accurately tokenizing words (no regex). Multiple natural languages supported. Useful for scrapping, machine learning, and data analysis.
For the full documentation, please see the repository:
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mnl_ws_norm-0.0.4.tar.gz
(2.7 kB
view details)
Built Distribution
File details
Details for the file mnl_ws_norm-0.0.4.tar.gz.
File metadata
- Download URL: mnl_ws_norm-0.0.4.tar.gz
- Upload date:
- Size: 2.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b6aef6e2a348e92b87859b96ea4119baa79973564c35e01fb8964a83c289c1d9 |
|
| MD5 | 1822c1936d29ef110428880bebf6f3b6 |
|
| BLAKE2b-256 | 7eb91bc9b4e5e0581c2f7d2ad6b2894da5f08cfa238b8fea5415c4329674a905 |
File details
Details for the file mnl_ws_norm-0.0.4-py3-none-any.whl.
File metadata
- Download URL: mnl_ws_norm-0.0.4-py3-none-any.whl
- Upload date:
- Size: 3.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 055804d6f371a2021476c2be062924e67fb5e5e5904502a3a78346ffbe4e50f5 |
|
| MD5 | 264f4bf1943f659f4f0dd0d139055969 |
|
| BLAKE2b-256 | cb382c50f527663cdbb70b27be0f45e43a24aa8279bf621f8be3ff532bcfe8bb |
