Skip to main content

text processing functions for small or big data files

Project description


The textTinyPy package consists of text processing functions for small or big data files. The source code is based on C++11 and wrapped in Python using Cython. It is tested on Linux (Debian) with Python 2.7 and there is currently one limitation :

  • there is no support for chinese, japanese, korean, thai or languages with ambiguous word boundaries.

The functionality of the textTinyPy is explained in the blog post

Details for the parameters of each class can be found in the package documentation

The package will work properly only if the following requirements are satisfied / installed :

System Requirements:

Python Requirements:

  • Cython>=0.23.5
  • pandas>=0.21.0
  • scipy>=0.13.0
  • numpy>=1.11.2
  • future>=0.15.2

The package can be installed from pypi using:

pip install textTinyPy

To upgrade use

pip install -U textTinyPy

Use the following link to report bugs/issues,

Installation of System Requirements on Linux (Debian):

The installation requires a gcc-4.8 or newer (this can be checked in a console using : gcc –version ).

If the gcc is older than 4.8 continue with step 1. else go to step 2.

1.: installation of gcc-4.9 and g++-4.9

sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y

sudo apt-get update

sudo apt-get install gcc-4.9

sudo apt-get install g++-4.9

sudo update-alternatives –install /usr/bin/gcc gcc /usr/bin/gcc-4.9 90

sudo update-alternatives –install /usr/bin/g++ g++ /usr/bin/g++-4.9 90

sudo update-alternatives –install /usr/bin/gcov gcov /usr/bin/gcov-4.9 90

2.: installation of boost version 1.55 (including boost-locale and boost-system)

sudo add-apt-repository ppa:boost-latest/ppa -y

sudo apt-get update

sudo apt-get install libboost1.55-dev libboost-filesystem1.55-dev libboost-locale1.55-dev

3.: installation of armadillo (including the requirements for Debian and Fedora)

armadillo requirements – Debian only

sudo apt-get install cmake libopenblas-dev libblas-dev libarpack++2-dev liblapack-dev

armadillo requirements – Fedora only

yum install cmake openblas-devel lapack-devel arpack-devel SuperLU-devel

armadillo installation version 7.600.2


tar xf armadillo-7.600.2.tar.xz

cd armadillo-7.600.2/

cmake .


sudo make install

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for textTinyPy, version 0.0.4
Filename, size File type Python version Upload date Hashes
Filename, size textTinyPy-0.0.4-py2.7-linux-x86_64.egg (3.5 MB) File type Egg Python version 2.7 Upload date Hashes View
Filename, size textTinyPy-0.0.4.tar.gz (3.8 MB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page