Asro Preprocessing
Library untuk preprocessing teks bahasa Indonesia, mencakup:
- Case folding (mengubah teks menjadi huruf kecil).
- Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
- Tokenisasi teks menjadi daftar kata.
- Penghapusan stopwords bawaan library.
- Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
- Penghapusan duplikat berdasarkan teks yang telah diproses.
- Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.
Instalasi
Instal library melalui PyPI dengan versi yang spesifik:
pip install asro_preprocessing==0.1.8
Metadata
Release files for asro-preprocessing 0.1.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| asro_preprocessing-0.1.8.tar.gz | 264.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| asro_preprocessing-0.1.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 527.2 kB
Release files / asro_preprocessing-0.1.8.tar.gz
| Download URL | asro_preprocessing-0.1.8.tar.gz |
|---|---|
| Size | 264.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
74d218e7d5b1131ccdbc32999329e797babb3374f26c120ffa96657d1df02590
|
|
BLAKE2b-256 checksum How to use checksums |
51e257786a904957e6488a18ce331b087df67d7a5efda764eeca96b03802c8db
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.5
|
Release files / asro_preprocessing-0.1.8-py3-none-any.whl
| Download URL | asro_preprocessing-0.1.8-py3-none-any.whl |
|---|---|
| Size | 262.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
73229b1f7d6d507533a3357b38bdd2cdfb387cb52d229bb0f473615540098aa1
|
|
BLAKE2b-256 checksum How to use checksums |
4b8debd087aecd033ce84dc3f802d782a5ce15fb635b88e5099133d4903cfc14
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.5
|