SWAHILI TEXT CLEANING LIBRARY FOR NATURAL LANGUAGE PROCESSING
Project description
SWAHILI CLEANER
Best Swahili Processing Library
Swahili Cleaner is the swahili version Text Processing library for Natural Language Processing
- ✨Magic ✨
Features
- It can clean text by removing emojs
- Remove Unicode characters
- Cleaning the urls
- Cleaning the html elements
- remove parentheses
- remove numbers and keep text/alphabet only
- set in lowercase
- Removing stop words both Swahili and English
- Cleaning the whitespaces
- Remove non-alphanumeric characters
- Remove non-alphabetic characters
- Remove short words
Installation
!pip install eganetswahilicleaner
How to use
from eganetswahilicleaner.clean import clean_text
train['text']=train['text'].apply(clean_text)
test['text']=test['text'].apply(clean_text)
Where train['text'] this is a column in a pandas dataframe
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file eganetswahilicleaner-0.1.0.tar.gz.
File metadata
- Download URL: eganetswahilicleaner-0.1.0.tar.gz
- Upload date:
- Size: 5.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2d25eeeb6f8e8fee0ef73cc18c78aa6c76e90fbde91f6b4ae27b219542e31c7c
|
|
| MD5 |
e97ea17873c0b2a5864ac8700436a82e
|
|
| BLAKE2b-256 |
3677cde7307829059dbcd440d324023addcc7f116aec83e92f304d08ad5dd2c6
|
