Phrase-first semantic tokenizer compiler for neural language models
Project description
The author of this package has not provided a project description
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ion_tokenizer-1.0.2.tar.gz
(200.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
ion_tokenizer-1.0.2-py3-none-any.whl
(221.5 kB
view details)
File details
Details for the file ion_tokenizer-1.0.2.tar.gz.
File metadata
- Download URL: ion_tokenizer-1.0.2.tar.gz
- Upload date:
- Size: 200.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e58bac6fd53e0a308e3d1eb06b59cff9c88c88087d26639711432b06e3f3db76
|
|
| MD5 |
b113334e13dd6f5d60b7d9e9847da6d4
|
|
| BLAKE2b-256 |
7d0a8c75db56d73353466ed2b4fbd7ee7ca7db2718fad04ae9cda2a339ec409e
|
File details
Details for the file ion_tokenizer-1.0.2-py3-none-any.whl.
File metadata
- Download URL: ion_tokenizer-1.0.2-py3-none-any.whl
- Upload date:
- Size: 221.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8ae2867a5fdc2ade98fc0d16a2462e7cff21b7cd6b18b1faf0007791bad686ad
|
|
| MD5 |
b22848a440f72ab4159220b1e04c86d5
|
|
| BLAKE2b-256 |
dddc4bd6430ea05626fb16e4fda7dde3477f20fd677c0d2e2906be1ce6d60b37
|
