Library untuk preprocessing teks bahasa Indonesia.
Project description
Asro Preprocessing
Library untuk preprocessing teks bahasa Indonesia, mencakup:
- Case folding (mengubah teks menjadi huruf kecil).
- Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
- Tokenisasi teks menjadi daftar kata.
- Penghapusan stopwords bawaan library.
- Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
- Penghapusan duplikat berdasarkan teks yang telah diproses.
- Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.
Instalasi
Instal library melalui PyPI dengan versi yang spesifik:
pip install asro_preprocessing==0.1.8
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
asro_preprocessing-0.1.8.tar.gz
(264.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file asro_preprocessing-0.1.8.tar.gz.
File metadata
- Download URL: asro_preprocessing-0.1.8.tar.gz
- Upload date:
- Size: 264.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
74d218e7d5b1131ccdbc32999329e797babb3374f26c120ffa96657d1df02590
|
|
| MD5 |
7e57acef58aa2974ddfbc51231cdfa11
|
|
| BLAKE2b-256 |
51e257786a904957e6488a18ce331b087df67d7a5efda764eeca96b03802c8db
|
File details
Details for the file asro_preprocessing-0.1.8-py3-none-any.whl.
File metadata
- Download URL: asro_preprocessing-0.1.8-py3-none-any.whl
- Upload date:
- Size: 262.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
73229b1f7d6d507533a3357b38bdd2cdfb387cb52d229bb0f473615540098aa1
|
|
| MD5 |
ee9d0ba0eefd8ffe0316c8489973d039
|
|
| BLAKE2b-256 |
4b8debd087aecd033ce84dc3f802d782a5ce15fb635b88e5099133d4903cfc14
|
