High-performance Rust acceleration for ALTA Tokenizer (Kinyarwanda BPE)

These details have not been verified by PyPI

Project links

Project description

ALTA Acceleration

High-performance Rust acceleration for ALTA Tokenizer — a BPE tokenizer for Kinyarwanda.

This package provides optional Rust-powered functions for faster BPE training, encoding, and text preprocessing. It is automatically detected and used by altatk when installed.

Installation

pip install alta-acceleration

Or install with the main tokenizer:

pip install altatk

What it accelerates

Operation	Function	Speedup
BPE merge loop	`rust_bpe_train_loop`, `RustBpeTrainer.step`	3–5x
File streaming + pretokenization	`rust_stream_pretokenize_file`	Memory-efficient
Text encoding	`rust_encode_text_raw_batch`	4–5x
Text preprocessing	`rust_preprocess_text`	3–5x
Pair counting	`rust_count_pairs`	Parallel via Rayon

Usage

You don't need to import this package directly. Once installed, altatk detects it automatically and uses the Rust-accelerated functions where available. If not installed, the tokenizer falls back to pure Python — no functionality is lost.

License

MIT

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

This version

0.3.1

Mar 10, 2026

0.3.0

Mar 10, 2026

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

alta_acceleration-0.3.1.tar.gz (15.3 kB view details)

Uploaded Mar 10, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

alta_acceleration-0.3.1-cp314-cp314-win_amd64.whl (932.9 kB view details)

Uploaded Mar 10, 2026 CPython 3.14Windows x86-64

alta_acceleration-0.3.1-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.14manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.14manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp314-cp314-macosx_11_0_arm64.whl (1.0 MB view details)

Uploaded Mar 10, 2026 CPython 3.14macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp314-cp314-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.14macOS 10.12+ x86-64

alta_acceleration-0.3.1-cp313-cp313-win_amd64.whl (933.4 kB view details)

Uploaded Mar 10, 2026 CPython 3.13Windows x86-64

alta_acceleration-0.3.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.13manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.13manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp313-cp313-macosx_11_0_arm64.whl (1.0 MB view details)

Uploaded Mar 10, 2026 CPython 3.13macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp313-cp313-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.13macOS 10.12+ x86-64

alta_acceleration-0.3.1-cp312-cp312-win_amd64.whl (933.7 kB view details)

Uploaded Mar 10, 2026 CPython 3.12Windows x86-64

alta_acceleration-0.3.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.12manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.12manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp312-cp312-macosx_11_0_arm64.whl (1.0 MB view details)

Uploaded Mar 10, 2026 CPython 3.12macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp312-cp312-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.12macOS 10.12+ x86-64

alta_acceleration-0.3.1-cp311-cp311-win_amd64.whl (935.5 kB view details)

Uploaded Mar 10, 2026 CPython 3.11Windows x86-64

alta_acceleration-0.3.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.11manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.11manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp311-cp311-macosx_11_0_arm64.whl (1.0 MB view details)

Uploaded Mar 10, 2026 CPython 3.11macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp311-cp311-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.11macOS 10.12+ x86-64

alta_acceleration-0.3.1-cp310-cp310-win_amd64.whl (937.7 kB view details)

Uploaded Mar 10, 2026 CPython 3.10Windows x86-64

alta_acceleration-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.10manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.10manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp310-cp310-macosx_11_0_arm64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.10macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp310-cp310-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.10macOS 10.12+ x86-64

alta_acceleration-0.3.1-cp39-cp39-win_amd64.whl (939.6 kB view details)

Uploaded Mar 10, 2026 CPython 3.9Windows x86-64

alta_acceleration-0.3.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.9manylinux: glibc 2.17+ x86-64

alta_acceleration-0.3.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.2 MB view details)

Uploaded Mar 10, 2026 CPython 3.9manylinux: glibc 2.17+ ARM64

alta_acceleration-0.3.1-cp39-cp39-macosx_11_0_arm64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.9macOS 11.0+ ARM64

alta_acceleration-0.3.1-cp39-cp39-macosx_10_12_x86_64.whl (1.1 MB view details)

Uploaded Mar 10, 2026 CPython 3.9macOS 10.12+ x86-64

File details

Details for the file alta_acceleration-0.3.1.tar.gz.

File metadata

Download URL: alta_acceleration-0.3.1.tar.gz
Upload date: Mar 10, 2026
Size: 15.3 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for alta_acceleration-0.3.1.tar.gz
Algorithm	Hash digest
SHA256	`4370dd1bbfd301da450b4503623f2abbcc709f2cf92a3b4cacf5d995291d1324`
MD5	`8f93db04aafad6179560a6bfa3bc2374`
BLAKE2b-256	`ea141301ca8ea2a4f0a9845bc647d521429203073c9842e5e14915d07770f8a7`

Algorithm	Hash digest
SHA256	`52599bb7f4916773beaf8f816a03ea890f93eb518a639544e710e16283d228cc`
MD5	`ea730564652c89d6ae2625047985b0ff`
BLAKE2b-256	`c93c648d6cf51f1c7a3589c3ed5bf0a7081aaea8e4070b39696ca61add5d9c4d`

Algorithm	Hash digest
SHA256	`8ab020b9067bd85c5d85483115f430736a4e6f108d15ed9f8cb43adf97815173`
MD5	`d8d9d124042a4d6c47cd4b255db87cc6`
BLAKE2b-256	`95a9d2c23335ffac0f735afaad219e989f217c7d7a0b368b086fb14ba13fbf9b`

Algorithm	Hash digest
SHA256	`0a49f2bca2dceadcefc158e196846519b249830e9c7018d1e0cf34efeeb087b9`
MD5	`e56d6c9473c85faf7b57254604254708`
BLAKE2b-256	`badcb7b48362680f89d542419c29ad11be41b590351dbbfaf5c016102e73a657`

Algorithm	Hash digest
SHA256	`a04b50d9edf2a49a557440137a4be2878394b1064d6fb765cf00e1b6fe6709bd`
MD5	`c0d87a8599f6a06f69ff955b079c347a`
BLAKE2b-256	`5df07a857c1ba83baf1550b5d95e83fc8d73b312672f935650bae792273a54d2`

Algorithm	Hash digest
SHA256	`bed61e94dcbf129d2806c0b7daafee1c9b6137fbff9074ea541e0f414d6f7289`
MD5	`7d6fb9ef5378f25eea971d3caf5f3fd6`
BLAKE2b-256	`01e1a3b1941bd2dea9b8ab9752c9a78b887392126bc362aba61daccf4de84f16`

Algorithm	Hash digest
SHA256	`082acfb53e36f39ec15235706f13591bb5660ddf59f4c59616ca61064b43416a`
MD5	`b6ac936237556c7e7440209834d208b3`
BLAKE2b-256	`5ba78aec5215f92d64cdd605792c3fc6d5d31a966adec98e1e7ebafb8bb3ccb7`

Algorithm	Hash digest
SHA256	`aaa97637b866373b3028bfdca14b6abf113601acc270dd9a3a6b636acf22c32d`
MD5	`70e46a9b1a2e409672db6e39b1f8dc62`
BLAKE2b-256	`01636cc38319b7d13a64e78918a19b49b458fe3b8b7cd8d96342c56831af6e1d`

Algorithm	Hash digest
SHA256	`0ce687e86ddaf97e4a41453d28d2ad9b554d11280407519e4a0c21ed9ebb9b78`
MD5	`4ec4bc1a43de44fd89f36aad2eabd65e`
BLAKE2b-256	`aac5a2aa16bc8523eaf079de1dee1ef1d7c0e70ea7f921fa62cf21f33dc7c331`

Algorithm	Hash digest
SHA256	`03f5bb05188e2814902547522fa610adf59b0e8b5434a90efe5d6e37a2a3c7da`
MD5	`460bcbb89bb96c137ff5fcfbba2a96f8`
BLAKE2b-256	`e83c5e66b286563829b2b7a07a6a2723ce93fe5ae42763572327f36bcad80ba8`

Algorithm	Hash digest
SHA256	`b6ac04e8d6948a130ac51cdcba132c0a389e22d05dbb8e91463b82d5201f77c1`
MD5	`fc779fd152dc23d1c14a1347e468b658`
BLAKE2b-256	`81dd5cf411e82577f7a8e31416149e25431b710f29437ca447c4b622344261cf`

Algorithm	Hash digest
SHA256	`3e47213808e65deb01ef045dc653620986ba2aefbb183c71d97782b29069421c`
MD5	`cef3fdd19845fa5ec33275c0da0b7ccc`
BLAKE2b-256	`d76b7ed53846fa4bfb92dbac9cd5115e8575a8aa1e2194f1f514a5acb5229183`

Algorithm	Hash digest
SHA256	`39c786f0a62acb7bd7819c3bedec91502178a55e67b734d90fa321f7e3cb0a0f`
MD5	`3c104c143c6908076f0f69760a38ef3a`
BLAKE2b-256	`26085023b8f6681c9d945052b54ec7b2587f9b7a1f1fbfa327c12394a16b045f`

Algorithm	Hash digest
SHA256	`78b07096edcff56d9ef5a8d1a93de835b663e41ed0c48b3fefced6e38a7db5ae`
MD5	`765b396f9c21e25e1ab86ed2b5222518`
BLAKE2b-256	`91af482a309efa9bfd4f54ab57bbe14e4da1a0b928cd00f076d60fbc33b0420a`

Algorithm	Hash digest
SHA256	`6901a8b6dce6ebf2992d4c8ac9925f8238b1d88d4e10929e82d7a9d8212d1648`
MD5	`de51af06e772b14cc9754406e6f579f0`
BLAKE2b-256	`b7e404def496dbbbd8fd7015538c251232c38e195eaa4878cb45702e27ccc7ce`

Algorithm	Hash digest
SHA256	`ebe497d6dd97dc331ffe0ebf17b7e90b797c7fd0c224db12cd684d75733399fe`
MD5	`919398c578c351f4d6cac9bd70b40f9a`
BLAKE2b-256	`86c1cb36acb534951bdb48a37ad38efe5cdcd77f41b74259feeefb7df46908a0`

Algorithm	Hash digest
SHA256	`2fe6c6232d549117dd54cb55ccea1d55424c6788a0610f25d24db43b76724a21`
MD5	`eba85f403e6e5135c32b94b8cf317870`
BLAKE2b-256	`e0c8b0b2b4c1f4bcbded2591b24c245a837c2efbab829362b64c58e0c39353d6`

Algorithm	Hash digest
SHA256	`2929918bad58d2826bdbf2cc0716aa504fa33b5c35e282383bb441a7d36273ac`
MD5	`ae2ec3df158aab8afd5311273e71214e`
BLAKE2b-256	`d81d2bde220fd08456c3d3f67257826b00a4fc8aa5146221d371d99f3381b901`

Algorithm	Hash digest
SHA256	`013167d1b0005c70e9b82884e31051079334fe13e0c3dfa09b20451adee8c9a9`
MD5	`861e2780818ba5303c5a754ef08fd47a`
BLAKE2b-256	`f04832c003c513725f2c6dad5340e3ab33fea0f14e883eef3cb44571ae3c1d93`

Algorithm	Hash digest
SHA256	`51956f82b1e0ee1c669746b9a3dee1a934eb53caee346d01cab52966894a12cd`
MD5	`87eccdcbd0395a338f897f9672bc68ce`
BLAKE2b-256	`55ef5d6df85309e19da52bb66f4fa8d11deb2ff7735b4d3a4540db41d89e4c7e`

Algorithm	Hash digest
SHA256	`5c5b52b6233ba21bd69be35164a424c0034219d1685868049230a5640bad4984`
MD5	`c3752912a2b8f0bb94f846bf8627a9b5`
BLAKE2b-256	`a80071436c853dcc7dd3a7c2d647e70c2c8d5597a9f5479e0fed6cfcfef074fb`

alta-acceleration 0.3.1

Navigation

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Project description

ALTA Acceleration

Installation

What it accelerates

Usage

License

Project details

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Release history Release notifications | RSS feed

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Algorithm	Hash digest
SHA256	`90d39a3a7c8f4bcdad081f705017de2d068e702e593122a8feedff852f2c7cfd`
MD5	`32c28986d8fef09d4422ddc76ba37131`
BLAKE2b-256	`e942fb4dae647e8da7c72aa717473ea82b6dbc8224b147d3b4c508e09eff8e1c`

Algorithm	Hash digest
SHA256	`fd489c16ed06d3d551a384c7f6ec80f87acbdf93952081e2ce3c68a3def3fc70`
MD5	`a2ce7d7d11cba710eee86af79401f92d`
BLAKE2b-256	`55250033721df686cef6f4d000dbc1117d5a5f20bb6c5651e0498d8175b9cce9`

Algorithm	Hash digest
SHA256	`0c3c6d51fd3e2dd1859220e22cf0e625f23d99ae24aca9b623ed314ad4f20a21`
MD5	`1fdcbcc2a3ffff459ae90b40bd418d44`
BLAKE2b-256	`d0900330ba28ea08de16c9e3480bcfd6d3088e6a2de0a2467c7721ac4972af7a`

Algorithm	Hash digest
SHA256	`d9257fdbdb0ec3c3b05e5484e2cf276f2952a608ad9f530de1e6da3250dd9f2e`
MD5	`b29966a3f005e6455068dd394b99cd4f`
BLAKE2b-256	`7d1207ccd6dcb509a06281e33907e36278034199b3e4f1332aa94a6b189a9c77`

Algorithm	Hash digest
SHA256	`c16337eb1611478f3eaade8b0e766b841edb5b9b64519e9f2d04384d8b501462`
MD5	`08f7737f74d0b878ad94d44589b6e242`
BLAKE2b-256	`d44c2feff96c0dda5b483b159c9216fd09eeeac633beff8aa54103ebfb7a69b7`

Algorithm	Hash digest
SHA256	`59b86492d220c8e877007541f2b1404b68f45f53312971e5fb64b0887bf5bd2c`
MD5	`f3bb7f4f5a0eb99a808cd563efc864a3`
BLAKE2b-256	`ca916addc298ff9f5d79d7062b0b0185bf6541eb4ee1d7446705f668e9fd3898`

Algorithm	Hash digest
SHA256	`3e039bde99887b5c81439e6030e5495da9b0323d020e410c878331411eba932e`
MD5	`3bd07ab1a5676432b3c99db64e720ecd`
BLAKE2b-256	`64e05231460364f51d7436cdf3ed567afb4eacac6185fbaf06ff6fa46ec68aba`

Algorithm	Hash digest
SHA256	`8ddef7806032a7d45b4a208cf7526f2b55961ec09f2d7a72a574981582f49b86`
MD5	`81c39ef8e4d0518c7149ee74347d3070`
BLAKE2b-256	`2eaf8afedcef9a1f0d90759b07c3f5afadc441330160138462b894cb75c79a81`

Algorithm	Hash digest
SHA256	`77633a0189d67f7c3c428c6c183e5ec051069113cec83c7b89f61a1b655a99ff`
MD5	`334c0c463319e2f584badd8b3f021565`
BLAKE2b-256	`59065d723e1a2c503879078c222142d13a52f1df16fef79ac4d399f866b8766c`

Algorithm	Hash digest
SHA256	`6e3c1b07baa267a72bb764bb073b0b04e20e9b3bc4fb8bdd976737b0c1c8f9f8`
MD5	`a6be28503635a6828120382c571b90c7`
BLAKE2b-256	`5db9fa892dfc1ca9ca9ca1b6f10877da3d6ab1aafb1ab0a2aba871a69a87f259`