Skip to main content

text processing functions for small or big data files

Project description


The textTinyPy package consists of text processing functions for small or big data files. The source code is based on C++11 and wrapped in Python using Cython. It is tested on Linux (Debian) with Python 2.7 and there is currently one limitation :

  • there is no support for chinese, japanese, korean, thai or languages with ambiguous word boundaries.

The functionality of the textTinyPy is explained in the blog post

Details for the parameters of each class can be found in the package documentation

The package will work properly only if the following requirements are satisfied / installed :

System Requirements:

Python Requirements:

  • Cython>=0.23.5
  • pandas>=0.21.0
  • scipy>=0.13.0
  • numpy>=1.11.2
  • future>=0.15.2

The package can be installed from pypi using:

pip install textTinyPy

To upgrade use

pip install -U textTinyPy

Use the following link to report bugs/issues,

Installation of System Requirements on Linux (Debian):

The installation requires a gcc-4.8 or newer (this can be checked in a console using : gcc –version ).

If the gcc is older than 4.8 continue with step 1. else go to step 2.

1.: installation of gcc-4.9 and g++-4.9

sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y

sudo apt-get update

sudo apt-get install gcc-4.9

sudo apt-get install g++-4.9

sudo update-alternatives –install /usr/bin/gcc gcc /usr/bin/gcc-4.9 90

sudo update-alternatives –install /usr/bin/g++ g++ /usr/bin/g++-4.9 90

sudo update-alternatives –install /usr/bin/gcov gcov /usr/bin/gcov-4.9 90

2.: installation of boost version 1.55 (including boost-locale and boost-system)

sudo add-apt-repository ppa:boost-latest/ppa -y

sudo apt-get update

sudo apt-get install libboost1.55-dev libboost-filesystem1.55-dev libboost-locale1.55-dev

3.: installation of armadillo (including the requirements for Debian and Fedora)

armadillo requirements – Debian only

sudo apt-get install cmake libopenblas-dev libblas-dev libarpack++2-dev liblapack-dev

armadillo requirements – Fedora only

yum install cmake openblas-devel lapack-devel arpack-devel SuperLU-devel

armadillo installation version 7.600.2


tar xf armadillo-7.600.2.tar.xz

cd armadillo-7.600.2/

cmake .


sudo make install

Project details

Release history Release notifications

This version
History Node


History Node


History Node


History Node


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
textTinyPy-0.0.4-py2.7-linux-x86_64.egg (3.5 MB) Copy SHA256 hash SHA256 Egg 2.7 Dec 22, 2017
textTinyPy-0.0.4.tar.gz (3.8 MB) Copy SHA256 hash SHA256 Source None Dec 22, 2017

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page