Skip to main content

Library untuk preprocessing teks bahasa Indonesia.

Project description

Asro Preprocessing

Library untuk preprocessing teks bahasa Indonesia, mencakup:

  • Case folding (mengubah teks menjadi huruf kecil).
  • Pembersihan teks dari URL, tanda baca, angka, dan lainnya.
  • Tokenisasi teks menjadi daftar kata.
  • Penghapusan stopwords bawaan library.
  • Normalisasi kata tidak baku ke kata baku dengan kamus bawaan.
  • Penghapusan duplikat berdasarkan teks yang telah diproses.
  • Deteksi sumber teks, membedakan apakah dari media atau individu, dengan menggunakan daftar nama media bawaan.

Instalasi

Instal library melalui PyPI dengan versi yang spesifik:

pip install asro_preprocessing==0.1.2

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asro_preprocessing-0.1.2.tar.gz (262.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

asro_preprocessing-0.1.2-py3-none-any.whl (261.3 kB view details)

Uploaded Python 3

File details

Details for the file asro_preprocessing-0.1.2.tar.gz.

File metadata

  • Download URL: asro_preprocessing-0.1.2.tar.gz
  • Upload date:
  • Size: 262.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.5

File hashes

Hashes for asro_preprocessing-0.1.2.tar.gz
Algorithm Hash digest
SHA256 9ee82be1a0e7b86518dd4654ef3581143bb101b6017a1a1d0f6bdfdaab19586b
MD5 e45707d2bbfd5286b6edcec3c2f950bd
BLAKE2b-256 1689bbd5c456e1ee1ee2d3457618048390236a8c0620f8d8d42739641ba46655

See more details on using hashes here.

File details

Details for the file asro_preprocessing-0.1.2-py3-none-any.whl.

File metadata

File hashes

Hashes for asro_preprocessing-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 4adcb2826182d663c69c3f05f632b31324d8a30e923fdaacb0c58492e29b7ef9
MD5 37e5c9adda3f465b6f7a000d996e8fef
BLAKE2b-256 6b016dcffae76fb96fe7f1901a51f5a8dcf194aee47b96fb127687a7f577d860

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page