Skip to main content

Fast Unicode-aware tokenizer implemented in Rust (PyO3 + maturin).

Project description

x

Generated by PyPI Release Studio (maturin / PyO3).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rust_tokenizer_sober-0.1.0-cp311-cp311-win_amd64.whl (774.6 kB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file rust_tokenizer_sober-0.1.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for rust_tokenizer_sober-0.1.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 6c68d9083552b61544123dea690fa3afc24d05fcee89071df5ba6f487a1deb10
MD5 0f0ce212c99fb51fe7d99c5820c9f7a6
BLAKE2b-256 cccfbc5b8fe7093d67a2f8ee14818a7c02dc2f38e1bebe92a3b074330e1412da

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page