PyPI recent updates for indic-tokenizer https://pypi.org/project/indic-tokenizer/ Recent updates to the Python Package Index for indic-tokenizer en 0.2.2 https://pypi.org/project/indic-tokenizer/0.2.2/ BPE tokenizer for Indic scripts (Devanagari, Bengali, Tamil, Telugu, and more) Sun, 14 Jun 2026 18:43:08 GMT 0.2.1 https://pypi.org/project/indic-tokenizer/0.2.1/ BPE tokenizer for Indic scripts (Devanagari, Bengali, Tamil, Telugu, and more) Sun, 14 Jun 2026 17:54:18 GMT 0.2.0 https://pypi.org/project/indic-tokenizer/0.2.0/ BPE tokenizer for Indic scripts (Devanagari, Bengali, Tamil, Telugu, and more) Sun, 14 Jun 2026 17:38:43 GMT 0.1.1 https://pypi.org/project/indic-tokenizer/0.1.1/ BPE tokenizer for Indic scripts (Devanagari, Bengali, Tamil, Telugu, and more) Sun, 14 Jun 2026 06:46:11 GMT 0.1.0 https://pypi.org/project/indic-tokenizer/0.1.0/ BPE tokenizer for Indic scripts (Devanagari, Bengali, Tamil, Telugu, and more) Sun, 14 Jun 2026 06:20:20 GMT