zope.ucol 1.0.2

Python access to ICU text collation

This package provides a Python interface to the International Component for Unicode (ICU).

Contents

• Change History

  • 1.0.2 (2006-10-16)

  • 1.0.1 (2006-10-16)

  • 1.0 (2006-10-16)

• Installation

• Detailed Documentation

  • Collator attributes

• Download

Change History

1.0.2 (2006-10-16)

Fixed setup file problems.

1.0.1 (2006-10-16)

Added missing import to setup.py.

1.0 (2006-10-16)

Initial version.

Installation

zope.ucol is installed via setup.py in the usual way.

You must have ICU installed. If ICU isn’t installed in the usual places for include files and libraries on your system, you can provide command-line options to setup.py when building the extensions, as in:

python2.4 setup.py build_ext \
  -I/home/jim/p/z4i/jim-icu/var/opt/icu/include \
  -L/home/jim/p/z4i/jim-icu/var/opt/icu/lib \
  -R/home/jim/p/z4i/jim-icu/var/opt/icu/lib

python2.4 setup.py install

Note that if the libraries are in an unusual place, you will want to specify their location using the -R option so you don’t have to specify it at run-time.

Detailed Documentation

Locale-based text collation using ICU

The zope.ucol package provides a minimal Pythonic wrapper around the u_col C API of the International Components for Unicode (ICU) library. It provides locale-based text collation.

To perform collation, you need to create a collator key factory for your locale. We’ll use the special “root” locale in this example:

>>> import zope.ucol
>>> collator = zope.ucol.Collator("root")

The collator has a key method for creating collation keys from unicode strings. The method can be passed as the key argument to list.sort or to the built-in sorted function.

>>> sorted([u'Sam', u'sally', u'Abe', u'alice', u'Terry', u'tim',
...        u'\U00023119', u'\u62d5'], key=collator.key)
[u'Abe', u'alice', u'sally', u'Sam', u'Terry', u'tim',
 u'\u62d5', u'\U00023119']

There is a cmp method for comparing 2 unicode strings, which can also be used when sorting:

>>> sorted([u'Sam', u'sally', u'Abe', u'alice', u'Terry', u'tim',
...        u'\U00023119', u'\u62d5'], collator.cmp)
[u'Abe', u'alice', u'sally', u'Sam', u'Terry', u'tim',
 u'\u62d5', u'\U00023119']

Note that it is almost always more efficient to pass the key method to sorting functions, rather than the cmp method. The cmp method is more efficient in the special case that strings are long and few and when they tend to differ at their beginnings. This is because computing the entire key can be much more expensive than comparison when the order can be determined based on analyzing a small portion of the original strings.

Collator attributes

You can ask a collator for it’s locale:

>>> collator.locale
'root'

and you can find out whether default collation information was used:

>>> collator.used_default_information
0
>>> collator = zope.ucol.Collator("eek")
>>> collator.used_default_information
1

Download