Kabyle Corpus Toolkit
Tools for downloading, processing, and normalizing Kabyle (kab) and Occitan (oci) language corpora from Tatoeba and other sources.
Features
- Download Tatoeba Data: Automated download of sentences and links from Tatoeba.org
- Parallel Corpus Creation: Build aligned English-Kabyle and English-Occitan sentence pairs
- French Chain Translation: Expand coverage by routing Kabyle→French→English translations
- Character Normalization: Fix encoding issues and normalize extended Latin characters
- Language Validation: Validate corpus quality using GlotLID FastText models
- Stopword Generation: Generate language-specific stopword lists from corpus statistics
Installation
Basic Installation
pip install kabyle-corpus-toolkit
1 maintainer
Metadata
1 maintainer
Release files for kabyle-corpus-toolkit 2.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| kabyle_corpus_toolkit-2.0.0.tar.gz | 22.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| kabyle_corpus_toolkit-2.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 49.5 kB
Release files / kabyle_corpus_toolkit-2.0.0.tar.gz
| Download URL | kabyle_corpus_toolkit-2.0.0.tar.gz |
|---|---|
| Size | 22.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6ad9b8b3b979b50e00179832871096dca5b160fc875ae7089c460b4b63f135f9
|
|
BLAKE2b-256 checksum How to use checksums |
2a9f2aa95bbce7c1ac1fa8a5c8f234ae9e16ae2362f9a7830faad5808b5b6eef
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.19
|
Release files / kabyle_corpus_toolkit-2.0.0-py3-none-any.whl
| Download URL | kabyle_corpus_toolkit-2.0.0-py3-none-any.whl |
|---|---|
| Size | 27.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8f92b9a976b301cbfd01b054664fe3ae4adaa9a53c6207d5ccbb6e9ed3e95e34
|
|
BLAKE2b-256 checksum How to use checksums |
fbe479ba20e1afb00e5b5592e5868e2153db44c3e269d69533304a75ddb020ac
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.19
|
