Skip to main content

Simple RTF tokenizer

Project description

RTF Tokenize

A simple RTF tokenizer.

API:

# Init:
from rtf_tokenize import RtfTokenizer
tokenizer = RtfTokenizer(rtf_string)
# Get next token (return `None` on end of string):
token = tokenizer.next_token()
# Rewind a token (next call to `next_token` will return it):
tokenizer.rewind_token(token)
# Current location (last tokenized, irrespective of rewound tokens):
position = tokenizer.lnum, tokenizer.cnum

Release history

1.0.1

  • add copy of LICENSE.txt to distribution

1.0.0

  • first public release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rtf_tokenize-1.0.1.tar.gz (11.5 kB view details)

Uploaded Source

Built Distributions

rtf_tokenize-1.0.1-cp313-cp313-win_amd64.whl (15.2 kB view details)

Uploaded CPython 3.13Windows x86-64

rtf_tokenize-1.0.1-cp313-cp313-musllinux_1_2_x86_64.whl (13.4 kB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.5 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp313-cp313-macosx_11_0_arm64.whl (12.4 kB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

rtf_tokenize-1.0.1-cp312-cp312-win_amd64.whl (15.2 kB view details)

Uploaded CPython 3.12Windows x86-64

rtf_tokenize-1.0.1-cp312-cp312-musllinux_1_2_x86_64.whl (13.4 kB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.5 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp312-cp312-macosx_11_0_arm64.whl (12.4 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

rtf_tokenize-1.0.1-cp311-cp311-win_amd64.whl (15.2 kB view details)

Uploaded CPython 3.11Windows x86-64

rtf_tokenize-1.0.1-cp311-cp311-musllinux_1_2_x86_64.whl (13.4 kB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp311-cp311-macosx_11_0_arm64.whl (12.4 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

rtf_tokenize-1.0.1-cp310-cp310-win_amd64.whl (15.2 kB view details)

Uploaded CPython 3.10Windows x86-64

rtf_tokenize-1.0.1-cp310-cp310-musllinux_1_2_x86_64.whl (13.4 kB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.5 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp310-cp310-macosx_11_0_arm64.whl (12.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl (15.2 kB view details)

Uploaded CPython 3.9Windows x86-64

rtf_tokenize-1.0.1-cp39-cp39-musllinux_1_2_x86_64.whl (13.3 kB view details)

Uploaded CPython 3.9musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.5 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp39-cp39-macosx_11_0_arm64.whl (12.3 kB view details)

Uploaded CPython 3.9macOS 11.0+ ARM64

rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl (15.1 kB view details)

Uploaded CPython 3.8Windows x86-64

rtf_tokenize-1.0.1-cp38-cp38-musllinux_1_2_x86_64.whl (13.1 kB view details)

Uploaded CPython 3.8musllinux: musl 1.2+ x86-64

rtf_tokenize-1.0.1-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (13.1 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ x86-64

rtf_tokenize-1.0.1-cp38-cp38-macosx_11_0_arm64.whl (12.1 kB view details)

Uploaded CPython 3.8macOS 11.0+ ARM64

File details

Details for the file rtf_tokenize-1.0.1.tar.gz.

File metadata

  • Download URL: rtf_tokenize-1.0.1.tar.gz
  • Upload date:
  • Size: 11.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.5

File hashes

Hashes for rtf_tokenize-1.0.1.tar.gz
Algorithm Hash digest
SHA256 9020aa801502b5de60be2b7709b9ce4cb29cd70df6f5fc4953315cf158035ad2
MD5 cc3b6ba936793405d39db62ff1a0db22
BLAKE2b-256 a2e1c700f2043567a9fce17adb2ae7d91f0f7f88e8e555eff5b8436b8f9cf6aa

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 a0a67ffb8c8eed359f89c3e1b03c09917cb0b0ca2d59ff15a2e467a7d2e80293
MD5 dec43350a81401e62c8eb81639526314
BLAKE2b-256 96d0785da5228fa1781d3ee96cbcec8995b9ca4f7f2f0e4fec2817a0df3fc0c7

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 8539dd710cf477d725dd948b17f233db0020aee7cd900cd709c058b1e860e0a2
MD5 d3096c7e909b503b8ffb98dc700a621f
BLAKE2b-256 b2629ea0913a21f2144fb027d1ff7aca4db699e7e914603555e2c80dbdde0355

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 7e2a967592a2d40170bad81dfe6733f9a252e36715f8de004b9b585eecd6fa57
MD5 b6f9018bcae6220d02ac25bf881c91bd
BLAKE2b-256 77d66a12f700247bb326e2aad2cea839f8687d41141b33dcfbff3741e3f8868e

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c80fd78cd30ef6b24a0ebc87dc2285e0d4cff580324261fd65b1d79def8dbe21
MD5 8963fe9546c8a9f06e9221b61db3a7eb
BLAKE2b-256 7948bef663568ea2ffd9e41408d60d6dc4787e540a62812d325f90fc56179df6

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 d97fd95175f3c7f56eb5c917e1d102a226d3e8983293740fa48b2efba1ad9c41
MD5 15afc6d4bf32cb6452e9042f916ef4b9
BLAKE2b-256 6084b16c898592b4598d61a4a0cfea3ec06177f6209982f3c24d1f4a0fd1dd3f

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 bab4f70b76b8df43f6284adda5283de0a5736e9437dc29f2afd8564eb6832f9f
MD5 80115a3498e92385501ba205a3cc89aa
BLAKE2b-256 a39d0be90b7807768781ffcc2bead86ab37f5fbc12ea7ce9adbb324175f054e4

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 c4b73e3bb9c02240870c344cbc90cc64631111e10da6e850865f57fe7f5acd52
MD5 61bf485dd3cecb995917f3b3bcbea072
BLAKE2b-256 52d6737f940c063df55b1ea52198ea06d9a859c0cc84d41176b89f1958549a43

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e27bbc03ac814e030b602d6b16db6e2d77bf0f4c879a1b793ea15089af9ca21f
MD5 8071d3455750fc456285d1f1bf92d9b7
BLAKE2b-256 f86658a1ed3c296bde08e10be91f076cb5efd3980f5fde0c7fe197d3ec996e36

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 5dfe59417f81628c41edc5ba00bc70b994a4ee15258e8984ed8a2ac889ad117e
MD5 5e9492530b0d92d599f0a5565d1e8f6b
BLAKE2b-256 e333748e16c0fe91a44689265604e36380b4d487128c93df152a8e0c2b69b14e

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 736b4fb566dc17d8d1cc9936c9e867453efd577edee5c3682be504928d0898da
MD5 e27281436bf2c589041a70d2c94b2734
BLAKE2b-256 9e8bf3507611fa91f61e8291d468a1868b66f882da4e409c9cef5bc09a46f5f8

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 5b3e818b41ba724ef20a556b5c5ad817a404c9cfbb53fea04de3238a195bec31
MD5 f8d7c3c947e50255882f696729f1889f
BLAKE2b-256 90017f8f842f1b42190e304dc5a858d759facd701222f6c235c4cc09186ce255

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 66ab7f2bd249e65056c4aa64085a7bd243243ca426891f4de23f026e782daf15
MD5 9ae19d903ecad3b985aa619b317a8617
BLAKE2b-256 244e8b1179875401144979aef30cc91d9a0fbb3c302b7ad2b3251b600fe06daf

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 6c38584ee4de8b70fc1509aa3050833ed55e51e1aa35d35c182caac6fe2ca4fa
MD5 96682264ad1c5e822f705087d0012894
BLAKE2b-256 0b5b939c0ed6a8374b72457b71a8d20052fa923f52f355e9a3d6edc69876f301

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 8185fff21702fe83a6faaddc397ee8ed8c0fd4ec238efb4eb790e1b20b89869b
MD5 2e40a9a7ffc2ecf4b8695bc238f08233
BLAKE2b-256 62093e0fc0e0f5b183ddd24564b1b98de860258cce40cc7f2794bebda1417c5b

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 805c53eae7055b726fa9322e0b8c3a6a11a8115823b209e7a4b2d32c82e2c6fc
MD5 a1e14e421ff8b278e91842271664c652
BLAKE2b-256 09197c5f5f24515aebbda86bb4aed0167ef788d08dfd6a3d91fa0a8cde3e8e07

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6966128b56d7d4740ceb222f1c838000075f8fb1b0814eb19a60a62fd256fe12
MD5 2757de3fa95e66eba49e04c81b6c3449
BLAKE2b-256 f1588a93770c3c5f40f48b639cefb6ff9ac492ff1fdd948811c3b11010fcbd6e

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 15.2 kB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.5

File hashes

Hashes for rtf_tokenize-1.0.1-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 a24177c0917b5556e75e18a0f5e51a03e0e2df4d206bf2a21f5a9b07bb0adc1a
MD5 79e434d8326f8f44110a31a6df8b695d
BLAKE2b-256 f99f1d7c240a1653d76a640121d152caefa2fae65c89be6cd92f459d25c1b853

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp39-cp39-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp39-cp39-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 2866d835b7a548e80065b2b9b0ac241f407c3aa0f788e3a22d9c5f39d3311df6
MD5 ac2563e921a0cf3bf424d289de4d6841
BLAKE2b-256 80f49aa7b450fe85ce80938f00da492e4f252444ed27065d061acce61a8d5afb

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 0508248d6a3af2f2bfca52844c589edf40109903e931397104d9e56fe2237aa6
MD5 da62422cb4439159ae5eb74d140f20f2
BLAKE2b-256 5016c0d4939e469663b718f1d54742992e9040f48591ed02b27ede758a48d008

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e7e3cb111e6719594f5ae2e25eec6c4176b80a4a55ec8090d202c8f343b6c302
MD5 9fce22dcb72bde13395283f9866085f6
BLAKE2b-256 751fbf6654492b0e607cdc1d76c20b6996b2ebfd01fd34b94e556691357c9889

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl.

File metadata

  • Download URL: rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl
  • Upload date:
  • Size: 15.1 kB
  • Tags: CPython 3.8, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.5

File hashes

Hashes for rtf_tokenize-1.0.1-cp38-cp38-win_amd64.whl
Algorithm Hash digest
SHA256 20bad6e5e4e2b55d66c9d4a1da3465940011d56cdc560c1b3ace85d299546bf3
MD5 ca67b34d79f0c01c10a8801f3c02e3ea
BLAKE2b-256 259fe99b9c15fb7ebc95a2dfa09045a62f28ce5b4b66134fbec874139858a06d

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp38-cp38-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp38-cp38-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 fba11c28c33326e26a1a4e842fe8d6a44259cf1c2b92465374e50bfbd1d2bfea
MD5 c2596cc73eeca02a9aa53f39fa7df93f
BLAKE2b-256 74ea0b687c4304c846481f6385fbfbd26999c95e472c6d0efef32d66269ac814

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp38-cp38-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 b15a261df179fbefda9e71c1b0ef27368eb1911f4da059b5c7c5f39e6138f923
MD5 e7729bac25df52cb518c7d06ce1a7b87
BLAKE2b-256 7f478e2835b97c2477bfbe6148ad9df46dceaab6b4ee12ce67211a92e43c0f46

See more details on using hashes here.

File details

Details for the file rtf_tokenize-1.0.1-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for rtf_tokenize-1.0.1-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 021ab8053d041501bd41956c274ce1a4ff758c50006707659de8c14e533b09c3
MD5 a017efad8bb21378cd48820b06b05f3b
BLAKE2b-256 7ec98de1839dc212853ceef5556745bff6ce67a7287e68e00e02783c604da559

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page