A streaming tokenizer.
Project description
pyTokenizer
A streaming tokenizer.
Contributors:
- Patrick Lehmann (Maintainer)
License
This library is licensed under Apache License 2.0
SPDX-License-Identifier: Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyTokenizer-1.1.2.tar.gz
(4.2 kB
view hashes)
Built Distribution
Close
Hashes for pyTokenizer-1.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44c9bc63f482ebec8768a8d0c58cb9fc2099f8c2a1f8dd354373b2b5e699391f |
|
MD5 | f5643babd3a7a60597e717b5a1c96762 |
|
BLAKE2b-256 | 9b212e92ee3b5e26b39a2a400e8319c07c3a8df861d10ba1da32184bae7db95d |