A streaming tokenizer.
Project description
pyTokenizer
A streaming tokenizer.
Contributors
- Patrick Lehmann (Maintainer)
License
This library is licensed under Apache License 2.0
SPDX-License-Identifier: Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyTokenizer-1.1.3.tar.gz
(4.6 kB
view hashes)
Built Distribution
Close
Hashes for pyTokenizer-1.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b055945bc2535d6e7609f6b554f223a2d7ee52767d3d1797b3e7546f1345936c |
|
MD5 | 9765e14abef031ddb99aff8327eb8ce4 |
|
BLAKE2b-256 | 46dd82ea601bb1a766fd35c52d1991531cec721b582416e3096b9cc2da1ca643 |