lzma-cf 0.0.4

LZMA and XZ compression for control freaks

lzma-cf

A Python LZMA & XZ library with greater control over compression parameters.

In addition to CPython's stdlib lzma, lzma-cf can

• Compress and decompress XZ files in multithreaded mode

Usage

>>> import lzma_cf
>>> uncompressed = b'qwertyuiopasdfghjklzxcvbnm1234567890' * 10_000_000
>>> compressed_singlethreaded = lzma_cf.compress(uncompressed)
>>> compressed_multithreaded = lzma_cf.compress(uncompressed, threads=0)
>>> compressed_singlethreaded == compressed_multithreaded
False
>>> uncompressed == lzma_cf.decompress(compressed_singlethreaded)
True
>>> uncompressed == lzma_cf.decompress(compressed_multithreaded)
True

$ python -mtimeit -s "import lzma_cf" -s "s=b'qwertyuiopasdfghjklzxcvbnm1234567890' * 10_000_000"  "lzma_cf.compress(s)"
1 loop, best of 5: 3.74 sec per loop
$ python -mtimeit -s "import lzma_cf" -s "s=b'qwertyuiopasdfghjklzxcvbnm1234567890' * 10_000_000" "lzma_cf.compress(s, threads=0)"
1 loop, best of 5: 685 msec per loop

Installation

pip install lzma-cf

or

uv pip install lzma-cf

License

BSD-3-Clause AND MIT AND PSF-2.0

History

lzma-cf is derived from code that has passed through multiple projects by multiple authors

1. CPython 3.3.0 added lzma to the stdlib in _lzmamodule.c & lzma.py
2. backports.lzma repackaged CPython C-API code & adapted it
3. lzmaffi forked backports.lzma & changed C-API bindings to CFFI bindings
4. PyPy incorporated lzmaffi code into their stdlib & updated it
5. lzma-cf (this project) uses PyPy code and builds on it