Skip to main content

Fast Unicode-aware tokenizer implemented in Rust (PyO3 + maturin).

Project description

The author of this package has not provided a project description

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rust_tokenizer_pyo3-0.1.0-cp311-cp311-win_amd64.whl (774.4 kB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file rust_tokenizer_pyo3-0.1.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for rust_tokenizer_pyo3-0.1.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 159700ce1f089a17decd18db00a278aae8c713e149f562ef0f32d4aa98421c17
MD5 2f35f323db6b44e109d623115ffacb0b
BLAKE2b-256 4af6d48addb11bf5525d4ba16c1a28c95fcce83c9d00aa951c08e6650be7a49b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page