A streaming tokenizer.
Project description
pyTokenizer
A streaming tokenizer.
Contributors:
- Patrick Lehmann (Maintainer)
License
This library is licensed under Apache License 2.0
SPDX-License-Identifier: Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyTokenizer-1.1.1.tar.gz
(4.1 kB
view hashes)
Built Distribution
Close
Hashes for pyTokenizer-1.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16b1831af36e7c2bf1d1f29bf9455afe0f4dda01dcf489d7347fadf2c233e31c |
|
MD5 | c6caa5f2f13fa570e85f36312b9b89b9 |
|
BLAKE2b-256 | a82e1bbef671260f327e464e22ee3ddfdc9de1465947bb7e771c71c9e8695dd1 |