A tokenization library for Bodo language
Project description
bodoTK
bodoTK is a Python library designed for tokenization of the Bodo language. This library provides functions to perform sentence-level, word-level, and character-level tokenization.
Features
- Sentence-level tokenization
- Word-level tokenization
- Character-level tokenization
Installation
You can install bodoTK using pip. To install it locally, use the following command:
pip install /path/to/your/package/bodoTK-0.1-py3-none-any.whl
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bodotk-1.1.tar.gz
(1.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
bodoTK-1.1-py3-none-any.whl
(2.2 kB
view details)
File details
Details for the file bodotk-1.1.tar.gz.
File metadata
- Download URL: bodotk-1.1.tar.gz
- Upload date:
- Size: 1.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ea2799048b7a4dbd1939e470bd66a5a5e160ef97f4bdce31f5288eacafb1d4fe
|
|
| MD5 |
84cf0acaa6e2544af579c62090432030
|
|
| BLAKE2b-256 |
0ad2e4013ad722bc149520463fc7b3d6810ff22c31af7e0ce18b29c45a70cd44
|
File details
Details for the file bodoTK-1.1-py3-none-any.whl.
File metadata
- Download URL: bodoTK-1.1-py3-none-any.whl
- Upload date:
- Size: 2.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1a9bb6fb71823c0d8a8ae58972be62ff54c24fe6316d2df662b6afa2a8b4aec5
|
|
| MD5 |
2c9421b3aa4414b8c54870bb626190c1
|
|
| BLAKE2b-256 |
f8213a6991f7c67fccf6cb8a6d88d6404d71bdb509a0689fb324af673dcd91c2
|
