strip-marks 1.0.1

Small Python library to strip non-spacing marks (e.g., diacritics) from a string

strip_marks

A small Python library for stripping non-spacing marks (e.g., diacritics; accents) from a string.

---

Quick Start

from strip_marks import strip_marks

assert strip_marks("şéàşöñ") == "season"
assert strip_marks("kaderdenkesişenyollarinhikayesi.xyz") == "kaderdenkesisenyollarinhikayesi.xyz"

def identity(x): return x
assert strip_marks("hello world") == identity("hello world")

Using strip_marks as a Library

This package is published on PyPI. You can install it with PIP:

$ pip add strip-marks

Or, if using UV for dependency management:

$ uv add strip-marks

Notes on Internal Functionality

This library uses Python's unicodedata standard library for normalising strings to strip marks.

Early (incomplete) versions of the library implemented (and used internally) functions adapted from the utf8proc C library to handle characters of multiple codepoints. This implementation used bitwise functionality from our sister package, ispunct. I would like to continue to explore this lower-level problem space to see if I can implement something in Python that is more efficient than the current implementation.

Alternative Libraries

This was written mostly as a proof of concept. A more developed library with this functionality is unidecode. A curious reader may also be interested in unihandecode/pykakasi or text-unidecode.

Citation

If your research depends on strip_marks, please consider giving us a formal citation: citation.bib.