A streaming tokenizer.
Project description
pyTokenizer
A streaming tokenizer.
Contributors:
- Patrick Lehmann (Maintainer)
License
This library is licensed under Apache License 2.0
SPDX-License-Identifier: Apache-2.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyTokenizer-0.1.3.tar.gz
(4.1 kB
view hashes)
Built Distribution
Close
Hashes for pyTokenizer-0.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bb4509feabca85867d6f7eafa74216b6a9b6c693dc8c69ede34d0a9df687d1e5 |
|
MD5 | fe86374d109f9104da264c50e6c3806b |
|
BLAKE2b-256 | d9e19af20afe462a6fb06d3b1c843b9e683d08e544c42613cf3d6f4d9345f120 |