Library untuk preprocessing teks bahasa Indonesia.
Project description
Asro Preprocessing
Library untuk preprocessing teks bahasa Indonesia, mencakup:
- Case folding (mengubah teks menjadi huruf kecil).
- Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
- Tokenisasi teks menjadi daftar kata.
- Penghapusan stopwords bawaan library.
- Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
- Penghapusan duplikat berdasarkan teks yang telah diproses.
- Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.
Instalasi
Instal library melalui PyPI dengan versi yang spesifik:
pip install asro_preprocessing==0.1.4
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
asro_preprocessing-0.1.6.tar.gz
(264.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file asro_preprocessing-0.1.6.tar.gz.
File metadata
- Download URL: asro_preprocessing-0.1.6.tar.gz
- Upload date:
- Size: 264.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e3344a072eac2cbfb877b508d989fc8fc9f0715e99e3384a88fcf80e1232d333
|
|
| MD5 |
3f07e75e1f464aeb364962550f80cf14
|
|
| BLAKE2b-256 |
85c01081e99fac9550347bb2d3eece177246710de28d41afa7407337891473fa
|
File details
Details for the file asro_preprocessing-0.1.6-py3-none-any.whl.
File metadata
- Download URL: asro_preprocessing-0.1.6-py3-none-any.whl
- Upload date:
- Size: 263.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f88c21cf6ba6801ef2407ad6d51c9e5bf5d1380ed3fc3276f73a431850e7537d
|
|
| MD5 |
6312d6ab10ff895f50c4de8a26208b72
|
|
| BLAKE2b-256 |
c5f398935d9bfc85fe72f7c00ed300159c7e54690f02e599df3ad21193a2ff00
|
