Skip to main content

unormalize

Converts UTF-8 input to the desired UTF-8 in Unicode normalization form.

Read about the Unicode Normalization Forms!

Usage

There are five executables included, that all have the exact same usage and arguments:

  • unormalize

  • nfc

  • nfd

  • nfkc

  • nfkd

You may either redirect or pipe input into unormalize (and its buddies), or provide filenames as arguments.

Options

-f FORM/--form=FORM

Selects the normalization form: one of NFC, NFD, NFKC, or NFKD. The equivalently named executables imply their respective normalization form; unormalize is equivilent to nfk without the --form arugment.

-i EXTENSION/--in-place EXTENSION

Filenames must be specified as arguments. If so, this opens them, and converts them into the desired normalization form, in place. EXTENSION is the extension given to back-ups of the original files.

Examples

Convert clipboard contents to NFC (macOS):

$ pbpaste | nfc | pbcopy

Convert a file, in-place, to NFKD:

$ nfkd --in-place=.bak file.txt && rm file.txt.bak

Convert circled, variants, and half-widths to their compatible forms:

$ echo 'ℍ①カ' | nfkc
H1カ

License

© 2015, 2017 Eddie Antonio Santos. MIT Licensed.

Metadata

Release files for unormalize 2020.7.17

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for unormalize 2020.7.17
File Size Uploaded
unormalize-2020.7.17.tar.gz 4.8 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for unormalize 2020.7.17
File Interpreter ABI Platform
unormalize-2020.7.17-py3-none-any.whl Python 3 none any Details
unormalize-2020.7.17-py2-none-any.whl Python 2 none any Details

Total release size: 14.0 kB

Release files / unormalize-2020.7.17.tar.gz

Download URL unormalize-2020.7.17.tar.gz
Size 4.8 kB
Tags Source
SHA-256 checksum
How to use checksums
bcfd7ea96da3b6f62defaedbfdb2a0615a6d6e77bf6edc3c1881255302443229
BLAKE2b-256 checksum
How to use checksums
badaa3100dfa5b5732b1cfce76cc6bbdad9c90e660ec0967eacb07a985806446
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.15.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/44.1.1 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/2.7.16

Release files / unormalize-2020.7.17-py3-none-any.whl

Download URL unormalize-2020.7.17-py3-none-any.whl
Size 4.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
808be2b67f60ab1cf7d4763f8562f494924d221a9299a811db6faf514840f39c
BLAKE2b-256 checksum
How to use checksums
97b373210a64610fcec7c6a9ef179fe5e5569d40229a59c23c1882ffddbc3d54
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.7.6

Release files / unormalize-2020.7.17-py2-none-any.whl

Download URL unormalize-2020.7.17-py2-none-any.whl
Size 4.6 kB
Tags Python 2
SHA-256 checksum
How to use checksums
e34a94fa972cabba95d525660dddd36f5511c16417fdae4d8f1b8ba78852f219
BLAKE2b-256 checksum
How to use checksums
3fe16deea8d017699dc9ee77482f585ea4814c0389fb639447fb7cefdbbd694b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.15.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/44.1.1 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/2.7.16

Release history Release notifications | RSS feed

This release

2020.7.17 This release

3 release files

0.2.0

2 release files

0.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page