chinese_to_english_punctuation 0.1.2

Welcome to chinese_to_english_punctuation Documentation

chinese_to_english_punctuation rewrites Chinese full-width punctuation into its English half-width equivalent, and fixes the spacing around it. Documents written by Chinese speakers about technical topics almost always end up mixing the two: the narrative uses ，。：；？！（）【】《》“” while the technical terms stay in English. That mix reads poorly in Markdown and reStructuredText, and it breaks tooling that expects ASCII punctuation. This library converts ， to ,, 。 to ., （） to (), 【】 and ［］ to [], 《》 and 〈〉 to <> and so on, inserts the single space that belongs between a Chinese character and an adjacent Latin word or number, and leaves everything else alone.

The conversion is line-oriented and deliberately conservative about structure. Leading indentation is preserved verbatim, so fenced code blocks, .. code-block directives and nested list continuations survive untouched. Runs of two or three identical marks (。。。, ？？？, ！！！) are treated as a single unit rather than being split apart. Spaces that would otherwise be introduced just inside paired Markdown markers such as **bold** are cleaned up afterwards.

The public Python API is a single function, process, which takes text and returns text. The same behavior is available from the command line through c2ep, which offers c2ep text for reading from --text or stdin and writing to stdout, and c2ep file for rewriting a UTF-8 file in place. Files that are not valid UTF-8 are rejected rather than guessed at, and --dry_run reports what would change without touching anything.

Usage:

from chinese_to_english_punctuation.api import process

process("这是Python代码，它使用Flask框架。")
# '这是 Python 代码, 它使用 Flask 框架.'

$ c2ep text --text "这是Python代码，它使用Flask框架。"
这是 Python 代码, 它使用 Flask 框架.

$ c2ep file --path ./README.md --dry_run
./README.md: 12 line(s) would change (dry run, nothing written)

$ c2ep file --path ./README.md
./README.md: 12 line(s) changed

$ pip install chinese-to-english-punctuation

$ pip install --upgrade chinese-to-english-punctuation