Tiny Tamil text utilities: normalize, tokenize, stopword removal, graphemes
Project description
tamil-utils
Tiny Tamil text utilities: normalize, tokens, remove_stopwords, graphemes.
from tamil_utils import normalize, tokens, remove_stopwords, graphemes
s = "இது ஒரு சோதனை 👋🏽"
print(tokens(s)) # ['இது', 'ஒரு', 'சோதனை']
print(remove_stopwords(tokens(s))) # ['சோதனை']
print(graphemes("👩🏽💻")) # ['👩🏽💻']
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tamil_utils-0.0.1.tar.gz
(3.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tamil_utils-0.0.1.tar.gz.
File metadata
- Download URL: tamil_utils-0.0.1.tar.gz
- Upload date:
- Size: 3.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6a242db387e1b2d0bb6e3f529f2db29790f8c8ca232760cfd6959d33ba246c77
|
|
| MD5 |
b9c8ab95a77842829b430b81e77df6c3
|
|
| BLAKE2b-256 |
a27215b68b6ccedbfce47c8dbfa0e067100280c7d3e2fc63086956de1cdb0248
|
File details
Details for the file tamil_utils-0.0.1-py3-none-any.whl.
File metadata
- Download URL: tamil_utils-0.0.1-py3-none-any.whl
- Upload date:
- Size: 4.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cdf3e071ec72073ab6be95a54ed2e02b70bc67eba2bda4c8adeb15ab12f47901
|
|
| MD5 |
0eb1c555bf953e9289096460a8a0fd66
|
|
| BLAKE2b-256 |
51daf36f44cfd3d6250028d65e44df2d0039941a462829c54b49f6fcb6baf333
|
