RTF Tokenize
A simple RTF tokenizer.
API:
# Init:
from rtf_tokenize import RtfTokenizer
tokenizer = RtfTokenizer(rtf_string)
# Get next token (return `None` on end of string):
token = tokenizer.next_token()
# Rewind a token (next call to `next_token` will return it):
tokenizer.rewind_token(token)
# Current location (last tokenized, irrespective of rewound tokens):
position = tokenizer.lnum, tokenizer.cnum
Release history
1.0.1
- add copy of LICENSE.txt to distribution
1.0.0
- first public release
3 maintainers
Metadata
3 maintainers
Release files for rtf-tokenize 1.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| rtf_tokenize-1.0.1.tar.gz | 11.5 kB | Details |
Built distributions (wheels)
Total release size: 336.9 kB
Release files / rtf_tokenize-1.0.1.tar.gz
| Download URL | rtf_tokenize-1.0.1.tar.gz |
|---|---|
| Size | 11.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9020aa801502b5de60be2b7709b9ce4cb29cd70df6f5fc4953315cf158035ad2
|
|
BLAKE2b-256 checksum How to use checksums |
a2e1c700f2043567a9fce17adb2ae7d91f0f7f88e8e555eff5b8436b8f9cf6aa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp313-cp313-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 15.2 kB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
a0a67ffb8c8eed359f89c3e1b03c09917cb0b0ca2d59ff15a2e467a7d2e80293
|
|
BLAKE2b-256 checksum How to use checksums |
96d0785da5228fa1781d3ee96cbcec8995b9ca4f7f2f0e4fec2817a0df3fc0c7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp313-cp313-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp313-cp313-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.4 kB |
| Tags | CPython 3.13 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
8539dd710cf477d725dd948b17f233db0020aee7cd900cd709c058b1e860e0a2
|
|
BLAKE2b-256 checksum How to use checksums |
b2629ea0913a21f2144fb027d1ff7aca4db699e7e914603555e2c80dbdde0355
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.5 kB |
| Tags | CPython 3.13 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
7e2a967592a2d40170bad81dfe6733f9a252e36715f8de004b9b585eecd6fa57
|
|
BLAKE2b-256 checksum How to use checksums |
77d66a12f700247bb326e2aad2cea839f8687d41141b33dcfbff3741e3f8868e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp313-cp313-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp313-cp313-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.4 kB |
| Tags | CPython 3.13 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c80fd78cd30ef6b24a0ebc87dc2285e0d4cff580324261fd65b1d79def8dbe21
|
|
BLAKE2b-256 checksum How to use checksums |
7948bef663568ea2ffd9e41408d60d6dc4787e540a62812d325f90fc56179df6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp312-cp312-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 15.2 kB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d97fd95175f3c7f56eb5c917e1d102a226d3e8983293740fa48b2efba1ad9c41
|
|
BLAKE2b-256 checksum How to use checksums |
6084b16c898592b4598d61a4a0cfea3ec06177f6209982f3c24d1f4a0fd1dd3f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp312-cp312-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp312-cp312-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.4 kB |
| Tags | CPython 3.12 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
bab4f70b76b8df43f6284adda5283de0a5736e9437dc29f2afd8564eb6832f9f
|
|
BLAKE2b-256 checksum How to use checksums |
a39d0be90b7807768781ffcc2bead86ab37f5fbc12ea7ce9adbb324175f054e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.5 kB |
| Tags | CPython 3.12 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
c4b73e3bb9c02240870c344cbc90cc64631111e10da6e850865f57fe7f5acd52
|
|
BLAKE2b-256 checksum How to use checksums |
52d6737f940c063df55b1ea52198ea06d9a859c0cc84d41176b89f1958549a43
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp312-cp312-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp312-cp312-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.4 kB |
| Tags | CPython 3.12 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e27bbc03ac814e030b602d6b16db6e2d77bf0f4c879a1b793ea15089af9ca21f
|
|
BLAKE2b-256 checksum How to use checksums |
f86658a1ed3c296bde08e10be91f076cb5efd3980f5fde0c7fe197d3ec996e36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp311-cp311-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 15.2 kB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
5dfe59417f81628c41edc5ba00bc70b994a4ee15258e8984ed8a2ac889ad117e
|
|
BLAKE2b-256 checksum How to use checksums |
e333748e16c0fe91a44689265604e36380b4d487128c93df152a8e0c2b69b14e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp311-cp311-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp311-cp311-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.4 kB |
| Tags | CPython 3.11 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
736b4fb566dc17d8d1cc9936c9e867453efd577edee5c3682be504928d0898da
|
|
BLAKE2b-256 checksum How to use checksums |
9e8bf3507611fa91f61e8291d468a1868b66f882da4e409c9cef5bc09a46f5f8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.5 kB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
5b3e818b41ba724ef20a556b5c5ad817a404c9cfbb53fea04de3238a195bec31
|
|
BLAKE2b-256 checksum How to use checksums |
90017f8f842f1b42190e304dc5a858d759facd701222f6c235c4cc09186ce255
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.4 kB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
66ab7f2bd249e65056c4aa64085a7bd243243ca426891f4de23f026e782daf15
|
|
BLAKE2b-256 checksum How to use checksums |
244e8b1179875401144979aef30cc91d9a0fbb3c302b7ad2b3251b600fe06daf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp310-cp310-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp310-cp310-win_amd64.whl |
|---|---|
| Size | 15.2 kB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
6c38584ee4de8b70fc1509aa3050833ed55e51e1aa35d35c182caac6fe2ca4fa
|
|
BLAKE2b-256 checksum How to use checksums |
0b5b939c0ed6a8374b72457b71a8d20052fa923f52f355e9a3d6edc69876f301
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp310-cp310-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp310-cp310-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.4 kB |
| Tags | CPython 3.10 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
8185fff21702fe83a6faaddc397ee8ed8c0fd4ec238efb4eb790e1b20b89869b
|
|
BLAKE2b-256 checksum How to use checksums |
62093e0fc0e0f5b183ddd24564b1b98de860258cce40cc7f2794bebda1417c5b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.5 kB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
805c53eae7055b726fa9322e0b8c3a6a11a8115823b209e7a4b2d32c82e2c6fc
|
|
BLAKE2b-256 checksum How to use checksums |
09197c5f5f24515aebbda86bb4aed0167ef788d08dfd6a3d91fa0a8cde3e8e07
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.4 kB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
6966128b56d7d4740ceb222f1c838000075f8fb1b0814eb19a60a62fd256fe12
|
|
BLAKE2b-256 checksum How to use checksums |
f1588a93770c3c5f40f48b639cefb6ff9ac492ff1fdd948811c3b11010fcbd6e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl |
|---|---|
| Size | 15.2 kB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
a24177c0917b5556e75e18a0f5e51a03e0e2df4d206bf2a21f5a9b07bb0adc1a
|
|
BLAKE2b-256 checksum How to use checksums |
f99f1d7c240a1653d76a640121d152caefa2fae65c89be6cd92f459d25c1b853
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp39-cp39-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp39-cp39-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.3 kB |
| Tags | CPython 3.9 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
2866d835b7a548e80065b2b9b0ac241f407c3aa0f788e3a22d9c5f39d3311df6
|
|
BLAKE2b-256 checksum How to use checksums |
80f49aa7b450fe85ce80938f00da492e4f252444ed27065d061acce61a8d5afb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.5 kB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
0508248d6a3af2f2bfca52844c589edf40109903e931397104d9e56fe2237aa6
|
|
BLAKE2b-256 checksum How to use checksums |
5016c0d4939e469663b718f1d54742992e9040f48591ed02b27ede758a48d008
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp39-cp39-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp39-cp39-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.3 kB |
| Tags | CPython 3.9 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e7e3cb111e6719594f5ae2e25eec6c4176b80a4a55ec8090d202c8f343b6c302
|
|
BLAKE2b-256 checksum How to use checksums |
751fbf6654492b0e607cdc1d76c20b6996b2ebfd01fd34b94e556691357c9889
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl
| Download URL | rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl |
|---|---|
| Size | 15.1 kB |
| Tags | CPython 3.8 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
20bad6e5e4e2b55d66c9d4a1da3465940011d56cdc560c1b3ace85d299546bf3
|
|
BLAKE2b-256 checksum How to use checksums |
259fe99b9c15fb7ebc95a2dfa09045a62f28ce5b4b66134fbec874139858a06d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp38-cp38-musllinux_1_2_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp38-cp38-musllinux_1_2_x86_64.whl |
|---|---|
| Size | 13.1 kB |
| Tags | CPython 3.8 Linux musl 1.2+ x86-64 |
|
SHA-256 checksum How to use checksums |
fba11c28c33326e26a1a4e842fe8d6a44259cf1c2b92465374e50bfbd1d2bfea
|
|
BLAKE2b-256 checksum How to use checksums |
74ea0b687c4304c846481f6385fbfbd26999c95e472c6d0efef32d66269ac814
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | rtf_tokenize-1.0.1-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 13.1 kB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
b15a261df179fbefda9e71c1b0ef27368eb1911f4da059b5c7c5f39e6138f923
|
|
BLAKE2b-256 checksum How to use checksums |
7f478e2835b97c2477bfbe6148ad9df46dceaab6b4ee12ce67211a92e43c0f46
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / rtf_tokenize-1.0.1-cp38-cp38-macosx_11_0_arm64.whl
| Download URL | rtf_tokenize-1.0.1-cp38-cp38-macosx_11_0_arm64.whl |
|---|---|
| Size | 12.1 kB |
| Tags | CPython 3.8 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
021ab8053d041501bd41956c274ce1a4ff758c50006707659de8c14e533b09c3
|
|
BLAKE2b-256 checksum How to use checksums |
7ec98de1839dc212853ceef5556745bff6ce67a7287e68e00e02783c604da559
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
