pyTokenizer
A streaming tokenizer.
Contributors
- Patrick Lehmann (Maintainer)
License
This Python package (source code) is licensed under Apache License 2.0.
SPDX-License-Identifier: Apache-2.0
Metadata
Release files for pyTokenizer 1.1.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pyTokenizer-1.1.4.tar.gz | 5.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pyTokenizer-1.1.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 14.1 kB
Release files / pyTokenizer-1.1.4.tar.gz
| Download URL | pyTokenizer-1.1.4.tar.gz |
|---|---|
| Size | 5.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d31e6e01730faae89383f32a0a4e497fb29955b291b941c556d92d43c110fd6c
|
|
BLAKE2b-256 checksum How to use checksums |
c0a631c06100242c4bbc1e6e68248e1df76d9eab16524b48d9b8550405054ddf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5
|
Release files / pyTokenizer-1.1.4-py3-none-any.whl
| Download URL | pyTokenizer-1.1.4-py3-none-any.whl |
|---|---|
| Size | 9.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
117de4342add39128cd38202f4af098ef6ee1938e6a7fd749f27093e6d23daca
|
|
BLAKE2b-256 checksum How to use checksums |
97588b6d3189bd4c10d1092763f53ed42bdba1bfea6374f5e66dd376d21cf7ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5
|