Skip to main content

Python library for converting between a string of ASCII and non-ASCII chars maintaining readability

Project description

RotUnicode is a Python library that can convert a string containing ASCII characters to a string with non-ASCII characters without losing readability.

>>> 'Hello World!'.encode('rotunicode')
Ĥȅľľő Ŵőŕľď!
>>> 'Ĥȅľľő Ŵőŕľď!'.decode('rotunicode')
Hello World!

In the above example, the ‘Hello World’ string has all ASCII characters. Encoding it with RotUnicode gives you ‘Ĥȅľľő Ŵőŕľď’ which reads like ‘Hello World’ but has all non-ASCII characters.

Why is this named RotUnicode?

RotUnicode stands for rotate-to-unicode. Or rotten-unicode for those who have nightmares about Unicode. It was inspired by Rot13.

Supported Characters

RotUnicode converts lower case and upper case characters of the English alphabet and digits 0 to 9 to non-ASCII characters. All characters that are outside this range are left as is.

>>> 'हेलो World!'.encode('rotunicode')
हेलो Ŵőŕľď!
>>> 'हेलो Ŵőŕľď!'.decode('rotunicode')
हेलो World!


To install, simply:

pip install rotunicode


>>> from rotunicode import ruencode
>>> ruencode('Hello World!')
Ĥȅľľő Ŵőŕľď!
>>> rudecode('Ĥȅľľő Ŵőŕľď!')
Hello World!

As a Codec

In Python 2, RotUnicode can also be used as a codec, but it must first be registered with the codecs library. This allows python to know what functions to call to encode or decode a string using RotUnicode.

>>> import codecs
>>> from rotunicode import RotUnicode
>>> codecs.register(RotUnicode.search_function)
>>> 'Hello World!'.encode('rotunicode')
Ĥȅľľő Ŵőŕľď!

Command Line

Installing RotUnicode also includes a command line tool.

$ rotunicode "Hello World"
Ĥȅľľő Ŵőŕľď!
$ rotunicode -d "Ĥȅľľő Ŵőŕľď!"
Hello World!
$ echo "Hello World!" > hello.txt
$ rotunicode -f hello.txt
Ĥȅľľő Ŵőŕľď!
$ cat hello.txt | rotunicode -f
Ĥȅľľő Ŵőŕľď!

Why should I use RotUnicode?

RotUnicode it extremely helpful in testing because it reduces the friction for developers to test with non-ASCII strings. Imagine for example that you have a class to represent a contact for your address book application:

class Contact(object):

    def __init__(self, first_name, last_name):
        super(Contact, self).__init__()
        self.first_name = first_name
        self.last_name = last_name

    def display_name(self):
        return '{} {}'.format(self.first_name, self.last_name)

Most developers would test this as follows:

from unittest import TestCase
from contact import Contact

class ContactTests(TestCase):

    def test_display_name(self):
        contact = Contact('John', 'Doe’)
        self.assertEqual('John Doe', contact.display_name()))

This test is good. But it is going to miss catching problems in the code with non-ASCII characters. Requiring developers to remember how to type non-ASCII characters is not practical. With RotUnicode, this is super easy:

from unittest import TestCase
from contact import Contact

class ContactTests(TestCase):

    def test_display_name_with_ascii_name(self):
        contact = Contact(u'John', u'Doe')
        self.assertEqual(u'John Doe', contact.display_name())

    def test_display_name_with_non_ascii_name(self):
        contact = Contact(ruencode(u'John'), ruencode(u'Doe'))
        self.assertEqual(ruencode(u'John Doe'), contact.display_name())

This is an example of a bug in Python (issue18695) with non-ASCII characters -

>>> import os, errno
>>> name = 'foo'.encode('rotunicode')
>>> os.mkdir(name)
>>> print(name)
>>> os.path.exists(name)
>>> os.statvfs(name)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-2:
ordinal not in range(128)




Create a virtual environment and install packages:

mkvirtualenv rotunicode
pip install -r requirements-dev.txt


Run all tests using:


The tox tests include code style checks via pep8 and pylint.

The tox tests are configured to run on Python 2.7, 3.4, 3.5, 3.6, 3.7, and PyPy2.7 (version 5.10).

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for rotunicode, version 2.3.0
Filename, size File type Python version Upload date Hashes
Filename, size rotunicode-2.3.0-py2.py3-none-any.whl (12.8 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size rotunicode-2.3.0.tar.gz (15.2 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page