A streaming tokenizer.
Project description
pyTokenizer
A streaming tokenizer.
Contributors:
- Patrick Lehmann (Maintainer)
License
This library is licensed under Apache License 2.0
SPDX-License-Identifier: Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyTokenizer-1.1.0.tar.gz
(4.1 kB
view hashes)
Built Distribution
Close
Hashes for pyTokenizer-1.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a8ba0bb856a525dbbbfccfb363422db178bf23d14a171d3d6bc86c9f95946154 |
|
MD5 | 625b9e0c952cc7c66bbcc6c5157d173b |
|
BLAKE2b-256 | 1a7f06ff34a034938510f6c8a295bdf65947ada51ef2298652d3e36941967483 |