Skip to main content

Python library for converting between a string of ASCII and non-ASCII chars maintaining readability

Project description

http://opensource.box.com/badges/active.svg https://travis-ci.org/box/rotunicode.png?branch=master https://coveralls.io/repos/box/rotunicode/badge.png https://img.shields.io/pypi/v/rotunicode.svg https://img.shields.io/pypi/dm/rotunicode.svg

RotUnicode is a Python library that can convert a string containing ASCII characters to a string with non-ASCII characters without losing readability.

>>> 'Hello World!'.encode('rotunicode')
Ĥȅľľő Ŵőŕľď!
>>> 'Ĥȅľľő Ŵőŕľď!'.decode('rotunicode')
Hello World!

In the above example, the ‘Hello World’ string has all ASCII characters. Encoding it with RotUnicode gives you ‘Ĥȅľľő Ŵőŕľď’ which reads like ‘Hello World’ but has all non-ASCII characters.

Why is this named RotUnicode?

RotUnicode stands for rotate-to-unicode. Or rotten-unicode for those who have nightmares about Unicode. It was inspired by Rot13.

Supported Characters

RotUnicode converts lower case and upper case characters of the English alphabet and digits 0 to 9 to non-ASCII characters. All characters that are outside this range are left as is.

>>> 'हेलो World!'.encode('rotunicode')
हेलो Ŵőŕľď!
>>> 'हेलो Ŵőŕľď!'.decode('rotunicode')
हेलो World!

Installation

To install, simply:

pip install rotunicode

Use

>>> from rotunicode import ruencode
>>> ruencode('Hello World!')
Ĥȅľľő Ŵőŕľď!
>>> rudecode('Ĥȅľľő Ŵőŕľď!')
Hello World!

As a Codec

In Python 2, RotUnicode can also be used as a codec, but it must first be registered with the codecs library. This allows python to know what functions to call to encode or decode a string using RotUnicode.

>>> import codecs
>>> from rotunicode import RotUnicode
>>> codecs.register(RotUnicode.search_function)
>>> 'Hello World!'.encode('rotunicode')
Ĥȅľľő Ŵőŕľď!

Command Line

Installing RotUnicode also includes a command line tool.

$ rotunicode "Hello World"
Ĥȅľľő Ŵőŕľď!
$ rotunicode -d "Ĥȅľľő Ŵőŕľď!"
Hello World!
$ echo "Hello World!" > hello.txt
$ rotunicode -f hello.txt
Ĥȅľľő Ŵőŕľď!
$ cat hello.txt | rotunicode -f
Ĥȅľľő Ŵőŕľď!

Why should I use RotUnicode?

RotUnicode it extremely helpful in testing because it reduces the friction for developers to test with non-ASCII strings. Imagine for example that you have a class to represent a contact for your address book application:

class Contact(object):

    def __init__(self, first_name, last_name):
        super(Contact, self).__init__()
        self.first_name = first_name
        self.last_name = last_name

    def display_name(self):
        return '{} {}'.format(self.first_name, self.last_name)

Most developers would test this as follows:

from unittest import TestCase
from contact import Contact

class ContactTests(TestCase):

    def test_display_name(self):
        contact = Contact('John', 'Doe’)
        self.assertEqual('John Doe', contact.display_name()))

This test is good. But it is going to miss catching problems in the code with non-ASCII characters. Requiring developers to remember how to type non-ASCII characters is not practical. With RotUnicode, this is super easy:

from unittest import TestCase
from contact import Contact

class ContactTests(TestCase):

    def test_display_name_with_ascii_name(self):
        contact = Contact(u'John', u'Doe')
        self.assertEqual(u'John Doe', contact.display_name())

    def test_display_name_with_non_ascii_name(self):
        contact = Contact(ruencode(u'John'), ruencode(u'Doe'))
        self.assertEqual(ruencode(u'John Doe'), contact.display_name())

This is an example of a bug in Python (issue18695) with non-ASCII characters -

>>> import os, errno
>>> name = 'foo'.encode('rotunicode')
>>> os.mkdir(name)
>>> print(name)
ƒőő
>>> os.path.exists(name)
True
>>> os.statvfs(name)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-2:
ordinal not in range(128)

Contribute

See CONTRIBUTING.

Setup

Create a virtual environment and install packages:

mkvirtualenv rotunicode
pip install -r requirements-dev.txt

Testing

Run all tests using:

tox

The tox tests include code style checks via pep8 and pylint.

The tox tests are configured to run on Python 2.7, 3.4, 3.5, 3.6, 3.7, and PyPy2.7 (version 5.10).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rotunicode-2.3.0.tar.gz (15.2 kB view hashes)

Uploaded source

Built Distribution

rotunicode-2.3.0-py2.py3-none-any.whl (12.8 kB view hashes)

Uploaded py2 py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page