Skip to main content

Fast text processing

Project description

# reTexto
Fast text processing for python

### Run

cd /[project_path]
docker build -t retexto .
docker run -v $(pwd):/retexto:rw -it retexto bash

### Test

invoke test

### Work in

docker run -v $(pwd):/retexto:rw -it retexto bash
invoke test

### Publish

invoke publishTest ..... all ok?
invoke publish

## Basic Use

if __name__ == '__main__':
s = '@Edux87, i need this | <br> \
<strong>UserName: çarlos </strong> \
i\'m from Perú 😛 \
#Friends #Text jajajajaja so fffunny \
loooveee thiiis 😌😎 \
@florenciaflor19 Si!!! sé vo… 🐷JUANA🐷 \
smile! haha jejeje jojojo jujuju jijijijajaja 😂'

text = ReTexto(s)
s = text.remove_html() \
.remove_mentions() \
.remove_tags() \
.remove_smiles(by='SMILING') \
.convert_specials() \
.convert_emoji() \
.remove_nochars(preserve_tilde=True) \
.remove_url() \
.remove_duplicate(r='a-jp-z') \
.remove_duplicate_vowels() \
.remove_duplicate_consonants() \
.remove_punctuation() \
.remove_multispaces() \
.lower() \
.remove_stopwords() \
['username', 'from', 'love', 'i', 'ned', 'funy', 'juana', 'vo', 'this', 'si', 'im', 'se', 'peru', 'smile', 'so', 'smiling', 'carlos']

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for retexto, version 1.6.0
Filename, size File type Python version Upload date Hashes
Filename, size retexto-1.6.0.tar.gz (25.5 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page