Library untuk preprocessing teks bahasa Indonesia.
Project description
Asro Preprocessing
Library untuk preprocessing teks bahasa Indonesia, mencakup:
- Case folding (mengubah teks menjadi huruf kecil).
- Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
- Tokenisasi teks menjadi daftar kata.
- Penghapusan stopwords bawaan library.
- Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
- Penghapusan duplikat berdasarkan teks yang telah diproses.
- Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.
Instalasi
Instal library melalui PyPI dengan versi yang spesifik:
pip install asro_preprocessing==0.1.2
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
asro_preprocessing-0.1.2.tar.gz
(262.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file asro_preprocessing-0.1.2.tar.gz.
File metadata
- Download URL: asro_preprocessing-0.1.2.tar.gz
- Upload date:
- Size: 262.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9ee82be1a0e7b86518dd4654ef3581143bb101b6017a1a1d0f6bdfdaab19586b
|
|
| MD5 |
e45707d2bbfd5286b6edcec3c2f950bd
|
|
| BLAKE2b-256 |
1689bbd5c456e1ee1ee2d3457618048390236a8c0620f8d8d42739641ba46655
|
File details
Details for the file asro_preprocessing-0.1.2-py3-none-any.whl.
File metadata
- Download URL: asro_preprocessing-0.1.2-py3-none-any.whl
- Upload date:
- Size: 261.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4adcb2826182d663c69c3f05f632b31324d8a30e923fdaacb0c58492e29b7ef9
|
|
| MD5 |
37e5c9adda3f465b6f7a000d996e8fef
|
|
| BLAKE2b-256 |
6b016dcffae76fb96fe7f1901a51f5a8dcf194aee47b96fb127687a7f577d860
|