One stop solution for text preprocessing on devanagari text
Project description
histr
I am only getting started, this package intends to be one stop solution for any kind of manipulation on Devanagari string, at the outset I have the following goals:
- Tokenize the Devanagari string at phoneme level, i.e. break down "अंकित" to ["अं", "कि", "त"]
- Identify and autocorrect (optionally) the text like अंंिकत to अंकित
I will keep adding to the list as came across more usecases or feature requests from downstream users
If you have any ideas on how to do this or you want to improve upon my work, PR(s) are always welcome.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
histr-0.0.1.tar.gz
(4.8 kB
view details)
Built Distribution
histr-0.0.1-py3-none-any.whl
(4.1 kB
view details)
File details
Details for the file histr-0.0.1.tar.gz.
File metadata
- Download URL: histr-0.0.1.tar.gz
- Upload date:
- Size: 4.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 187e0419cc8b12a66c55b3fa0c45ea5a437e4d89b1d7331e5dc5a0405056484b |
|
| MD5 | 110ad38e37e1da82503dff9a1292ab49 |
|
| BLAKE2b-256 | 6e42054f8390a658095189d635f22261527ea07a23288ebb1d603da878c0609b |
File details
Details for the file histr-0.0.1-py3-none-any.whl.
File metadata
- Download URL: histr-0.0.1-py3-none-any.whl
- Upload date:
- Size: 4.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2f2e66c3a14006c4c490b1b1bb44a3bc162e4fa320371083334c109afbc5d079 |
|
| MD5 | 182311f0c43431229c15088c9d17e137 |
|
| BLAKE2b-256 | 7aa3e5db39bd180d9ec2aae02fc039c365cfa2fdfcd1beef1053f98fbb5a54f4 |
