Library untuk preprocessing teks bahasa Indonesia.
Project description
Asro Preprocessing
Library untuk preprocessing teks bahasa Indonesia, mencakup:
- Case folding (mengubah teks menjadi huruf kecil).
- Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
- Tokenisasi teks menjadi daftar kata.
- Penghapusan stopwords bawaan library.
- Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
- Penghapusan duplikat berdasarkan teks yang telah diproses.
- Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.
Instalasi
Instal library melalui PyPI dengan versi yang spesifik:
pip install asro_preprocessing==0.1.6
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
asro_preprocessing-0.1.7.tar.gz
(264.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file asro_preprocessing-0.1.7.tar.gz.
File metadata
- Download URL: asro_preprocessing-0.1.7.tar.gz
- Upload date:
- Size: 264.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
19e3a6771bd0516fa1c80459c353dff85d0a8b6ee0f422649ad73fe4904069d2
|
|
| MD5 |
1fc573c6d35ea40a7a2b22d8fde59bc5
|
|
| BLAKE2b-256 |
ae45cce78f7a9bdb871320af68f0f0e6a5480215bf7bb56a6395572ba416e4bf
|
File details
Details for the file asro_preprocessing-0.1.7-py3-none-any.whl.
File metadata
- Download URL: asro_preprocessing-0.1.7-py3-none-any.whl
- Upload date:
- Size: 262.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
363d5d0cfff89428062edc2a067f952924acd2ea0a160f1c21082013bb06bf0e
|
|
| MD5 |
4f31ab9300c1fe55a9f9ed49bfb9b726
|
|
| BLAKE2b-256 |
86750f88e26e334ac58526907cd18d9a5b2bc19266345c152f5ef910bc48a6cc
|
