LZMA Multi-Threaded

Multi-threaded LZMA/XZ compression for Python.

A drop-in replacement for Python's lzma module with multi-threading support, implemented as a Cython wrapper around liblzma.

Installation

pip install lzma-mt

Build from source

Requires liblzma development headers:

# Ubuntu/Debian
sudo apt install liblzma-dev

# macOS
brew install xz

# Fedora/RHEL
sudo dnf install xz-devel

Then install:

pip install .

Usage

Quick start

import lzma_mt

# Compress with 4 threads
compressed = lzma_mt.compress(data, threads=4)

# Decompress with 4 threads
decompressed = lzma_mt.decompress(compressed, threads=4)

# Use threads=0 for auto-detect based on CPU count
compressed = lzma_mt.compress(data, threads=0)

Drop-in replacement for lzma

The API matches Python's lzma module exactly, with an additional threads parameter:

import lzma_mt

# One-shot compression/decompression
compressed = lzma_mt.compress(data, preset=6, threads=4)
decompressed = lzma_mt.decompress(compressed, threads=4)

# Streaming compression
compressor = lzma_mt.LZMACompressor(preset=6, threads=4)
out = compressor.compress(chunk1)
out += compressor.compress(chunk2)
out += compressor.flush()

# Streaming decompression
decompressor = lzma_mt.LZMADecompressor(threads=4)
result = decompressor.decompress(compressed)

# File I/O
with lzma_mt.open("file.xz", "wb", threads=4) as f:
    f.write(data)

with lzma_mt.open("file.xz", "rb", threads=4) as f:
    data = f.read()

All lzma constants are available

from lzma_mt import (
    FORMAT_XZ, FORMAT_ALONE, FORMAT_RAW, FORMAT_AUTO,
    CHECK_CRC64, CHECK_SHA256, CHECK_NONE,
    PRESET_DEFAULT, PRESET_EXTREME,
    # ... all other lzma constants
)

Thread parameter

The threads parameter controls parallelism:

Value	Behavior
`1`	Single-threaded (default). Uses the same liblzma code paths as the stdlib; compressed output is byte-identical to `lzma.compress()`
`0`	Auto-detect based on CPU count
`N`	Use N threads

Multi-threading is only used for XZ format (FORMAT_XZ). Other formats fall back to the single-threaded stdlib implementation; with FORMAT_AUTO, the container format is detected from the data, so legacy .lzma files work too.

Security

CVE-2025-31115

xz-utils versions 5.3.3alpha through 5.8.0 have a use-after-free vulnerability in the multi-threaded decoder (lzma_stream_decoder_mt). This module:

Checks the xz-utils version at runtime
Silently falls back to the single-threaded decoder on vulnerable versions — the same code path the stdlib uses, which is unaffected by the CVE
Uses the multi-threaded decoder only on xz-utils >= 5.8.1
With threads=1 (the default), always uses the single-threaded decoder, on all versions

The official wheels bundle xz-utils 5.8.1.

Check your system:

import lzma_mt

print(lzma_mt.get_xz_version())      # e.g., "5.8.1"
print(lzma_mt.is_mt_decoder_safe())  # True if safe for MT decoding

Memory limits

When decompressing untrusted data, always set a memory limit:

# Limit memory to 100 MB
lzma_mt.decompress(data, memlimit=100 * 1024 * 1024, threads=4)

# Or with streaming
decompressor = lzma_mt.LZMADecompressor(memlimit=100 * 1024 * 1024, threads=4)

Thread safety

Compressor and decompressor instances are internally locked and safe to use from multiple Python threads. However:

Compressor: Interleaved compress() calls produce output in undefined order
Decompressor: Decompression is inherently sequential

For predictable results, use one instance per thread.

Performance

Multi-threaded compression scales well with CPU cores. Decompression scaling depends on the compressed data having multiple independent blocks.

Benchmarks on Wikipedia text (enwik8), comparing lzma_mt, Python's stdlib lzma, and the xz command-line tool (AMD Ryzen 9 5900X, 12 cores / 24 threads, 64 GB RAM):

Benchmark results

Compression: lzma_mt matches xz binary speed (both use liblzma)
Decompression: lzma_mt is ~20-25% faster than xz due to no subprocess overhead
Threading: Significant speedups at larger data sizes (4-8x with auto threads)

import lzma_mt
import time

data = b"x" * 100_000_000  # 100 MB

# Single-threaded
t0 = time.time()
lzma_mt.compress(data, threads=1)
print(f"1 thread: {time.time() - t0:.2f}s")

# Multi-threaded
t0 = time.time()
lzma_mt.compress(data, threads=0)
print(f"Auto threads: {time.time() - t0:.2f}s")

API Reference

Functions

compress(data, format=FORMAT_XZ, check=-1, preset=None, filters=None, *, threads=1) - Compress data
decompress(data, format=FORMAT_AUTO, memlimit=None, filters=None, *, threads=1) - Decompress data
open(filename, mode="rb", *, format=None, check=-1, preset=None, filters=None, encoding=None, errors=None, newline=None, threads=1) - Open an LZMA file
is_check_supported(check) - Check if integrity check type is supported
get_xz_version() - Return xz-utils version string
is_mt_decoder_safe() - Check if MT decoder is safe from CVE-2025-31115

Classes

LZMACompressor(format=FORMAT_XZ, check=-1, preset=None, filters=None, *, threads=1) - Streaming compressor
LZMADecompressor(format=FORMAT_AUTO, memlimit=None, filters=None, *, threads=1) - Streaming decompressor
LZMAFile(filename, mode="r", *, format=None, check=-1, preset=None, filters=None, threads=1) - File object for LZMA files
LZMAError - Exception for LZMA errors

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lzma_mt-0.2.0.tar.gz (818.7 kB view details)

Uploaded Jul 24, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

lzma_mt-0.2.0-cp313-cp313-win_amd64.whl (213.7 kB view details)

Uploaded Jul 24, 2026 CPython 3.13Windows x86-64

lzma_mt-0.2.0-cp313-cp313-musllinux_1_2_x86_64.whl (983.7 kB view details)

Uploaded Jul 24, 2026 CPython 3.13musllinux: musl 1.2+ x86-64

lzma_mt-0.2.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (966.2 kB view details)

Uploaded Jul 24, 2026 CPython 3.13manylinux: glibc 2.17+ x86-64

lzma_mt-0.2.0-cp313-cp313-macosx_11_0_arm64.whl (406.7 kB view details)

Uploaded Jul 24, 2026 CPython 3.13macOS 11.0+ ARM64

lzma_mt-0.2.0-cp313-cp313-macosx_10_13_x86_64.whl (335.2 kB view details)

Uploaded Jul 24, 2026 CPython 3.13macOS 10.13+ x86-64

lzma_mt-0.2.0-cp312-cp312-win_amd64.whl (213.7 kB view details)

Uploaded Jul 24, 2026 CPython 3.12Windows x86-64

lzma_mt-0.2.0-cp312-cp312-musllinux_1_2_x86_64.whl (984.3 kB view details)

Uploaded Jul 24, 2026 CPython 3.12musllinux: musl 1.2+ x86-64

lzma_mt-0.2.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (971.9 kB view details)

Uploaded Jul 24, 2026 CPython 3.12manylinux: glibc 2.17+ x86-64

lzma_mt-0.2.0-cp312-cp312-macosx_11_0_arm64.whl (407.1 kB view details)

Uploaded Jul 24, 2026 CPython 3.12macOS 11.0+ ARM64

lzma_mt-0.2.0-cp312-cp312-macosx_10_13_x86_64.whl (335.8 kB view details)

Uploaded Jul 24, 2026 CPython 3.12macOS 10.13+ x86-64

lzma_mt-0.2.0-cp311-cp311-win_amd64.whl (214.6 kB view details)

Uploaded Jul 24, 2026 CPython 3.11Windows x86-64

lzma_mt-0.2.0-cp311-cp311-musllinux_1_2_x86_64.whl (1.0 MB view details)

Uploaded Jul 24, 2026 CPython 3.11musllinux: musl 1.2+ x86-64

lzma_mt-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (982.3 kB view details)

Uploaded Jul 24, 2026 CPython 3.11manylinux: glibc 2.17+ x86-64

lzma_mt-0.2.0-cp311-cp311-macosx_11_0_arm64.whl (406.3 kB view details)

Uploaded Jul 24, 2026 CPython 3.11macOS 11.0+ ARM64

lzma_mt-0.2.0-cp311-cp311-macosx_10_9_x86_64.whl (334.9 kB view details)

Uploaded Jul 24, 2026 CPython 3.11macOS 10.9+ x86-64

lzma_mt-0.2.0-cp310-cp310-win_amd64.whl (214.6 kB view details)

Uploaded Jul 24, 2026 CPython 3.10Windows x86-64

lzma_mt-0.2.0-cp310-cp310-musllinux_1_2_x86_64.whl (965.3 kB view details)

Uploaded Jul 24, 2026 CPython 3.10musllinux: musl 1.2+ x86-64

lzma_mt-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (945.9 kB view details)

Uploaded Jul 24, 2026 CPython 3.10manylinux: glibc 2.17+ x86-64

lzma_mt-0.2.0-cp310-cp310-macosx_11_0_arm64.whl (407.2 kB view details)

Uploaded Jul 24, 2026 CPython 3.10macOS 11.0+ ARM64

lzma_mt-0.2.0-cp310-cp310-macosx_10_9_x86_64.whl (335.8 kB view details)

Uploaded Jul 24, 2026 CPython 3.10macOS 10.9+ x86-64

lzma_mt-0.2.0-cp39-cp39-win_amd64.whl (215.5 kB view details)

Uploaded Jul 24, 2026 CPython 3.9Windows x86-64

lzma_mt-0.2.0-cp39-cp39-musllinux_1_2_x86_64.whl (962.2 kB view details)

Uploaded Jul 24, 2026 CPython 3.9musllinux: musl 1.2+ x86-64

lzma_mt-0.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (942.5 kB view details)

Uploaded Jul 24, 2026 CPython 3.9manylinux: glibc 2.17+ x86-64

lzma_mt-0.2.0-cp39-cp39-macosx_11_0_arm64.whl (407.6 kB view details)

Uploaded Jul 24, 2026 CPython 3.9macOS 11.0+ ARM64

lzma_mt-0.2.0-cp39-cp39-macosx_10_9_x86_64.whl (336.2 kB view details)

Uploaded Jul 24, 2026 CPython 3.9macOS 10.9+ x86-64

File details

Details for the file lzma_mt-0.2.0.tar.gz.

File metadata

Download URL: lzma_mt-0.2.0.tar.gz
Upload date: Jul 24, 2026
Size: 818.7 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for lzma_mt-0.2.0.tar.gz
Algorithm	Hash digest
SHA256	`6c6bd7102ddfc2a382445699e11a8eb5f49fa435dfd57d872ae9ec93ef1a3957`
MD5	`40d3afb3323bd10317e3d67391b42eca`
BLAKE2b-256	`ec5f08722cd53bd647d8c00328081d2a4cde8421a0194aafa7daed5a3f24276c`

Algorithm	Hash digest
SHA256	`18a7d1a100f96689a76c36d3ef56f4442750452df9fe87123e6520cd88335c36`
MD5	`b92352c265feedf57027dc844710e5db`
BLAKE2b-256	`6be51b64aaa0cce6fae1210a5e34b5d4146ffe7868757cf369f811be3f676702`

Algorithm	Hash digest
SHA256	`7910d42485e3410bac213572c9cd4c4da6de85b8fb7088981fa48374eb280d34`
MD5	`d0141efa42f12cade3615fe8cf39ffca`
BLAKE2b-256	`3cb6141ac77ffbeae9e538e71384e7ca1807e5407c8124faa9edb57ebfc82df9`

Algorithm	Hash digest
SHA256	`5213ce53fcc386550bb1b238e455ff1aa95725610564d6164046ec91f3fce6ec`
MD5	`23f3825547c24e269f4b8f290e95fc10`
BLAKE2b-256	`4a5fcb5c5ac19f60bd758afb37eb6c80d6be19454caa7132f9bc488c470c389d`

Algorithm	Hash digest
SHA256	`03804a3eee897233f6d81d8ff93c5ca4e51d5acff5e12fc2d9340f1203eacb2b`
MD5	`6002ee7f8a4af6bf1bea80c3463fc67d`
BLAKE2b-256	`ad6d0e42d70e238de54e7419951d17e721f62dcc654de6937aae9720ddbd6835`

Algorithm	Hash digest
SHA256	`8f42cb0b4e553d74c2e87314e644b685541d01484da8cf05451245a82f6c28f5`
MD5	`ce0307ce39293a2489120a7f1ff9fe94`
BLAKE2b-256	`c35fa5f04b5ce7d7420859f89b0d08eaed1e2d07126c8ac7b0893fa5a5498b65`

Algorithm	Hash digest
SHA256	`aadb1f42ffc3bc7cde8ec384e9b6da55634811059f1c1dcedc864449329eccc7`
MD5	`540ff6411eb53e8d24c02936a39c020b`
BLAKE2b-256	`86f1c3699e3ad18ad8bc4a04c86ad6a51218c74239a29ee36e1b2a0eb277f85b`

Algorithm	Hash digest
SHA256	`a9f0d6b6625162817ebca8fba274dff044f4e68839761d3d62cd8a9ff46416e0`
MD5	`79ba09dc45ab6e57eb61167eaa2a51df`
BLAKE2b-256	`04a4eedc96f9fe753e94558285b0607a6bb369ed6924692dce2b81afbe69cf93`

Algorithm	Hash digest
SHA256	`c96b3466b5a8214fcbf5f32b7d46da38959fbd07469a7e44e1cbb7aae45a6a0c`
MD5	`9c7eadd6ef7f1b65f02b9397f446a32a`
BLAKE2b-256	`723fa1f015990986b606a5ea4ad8914a64bf20152d4a787dcbf7ce27f054c2a5`

Algorithm	Hash digest
SHA256	`dbb6958b580fa1d2c3238a0cc1688c681c09cfc00cf12efb05420003f89d5792`
MD5	`c15d5999e02623ec520dbb8f115510e8`
BLAKE2b-256	`f50e94d71762b1e909fe55127ff7a699ae722bc83bb27e8d71cf5ac1c817259c`

Algorithm	Hash digest
SHA256	`c6d4bb5d6ff1cf26cad9638041ab56c6fdf1e38a7d12b05cd57bd6affd38817b`
MD5	`fc39ae4688fb64a6d8f9af0a8734b9a0`
BLAKE2b-256	`76defe02822e9b7c8c0d27f2f31cb9578b57b9d63fbfb44b979aa0d821161c5a`

Algorithm	Hash digest
SHA256	`b35b9b190124bdc1ab32de3e4f832646e6881197e4aec73535977390575d3fc7`
MD5	`6726fc861a3e134057e07aac740de893`
BLAKE2b-256	`4a3fa2db98136e9b448a175ca0740fe8739f4d1884194ef9e07d95c8ecb69388`

Algorithm	Hash digest
SHA256	`3ec16bb229b047110280c510e5e8198603897b3321382bea75eb939ccf408094`
MD5	`ce6a44452c0cd0f0e47596f39cba4042`
BLAKE2b-256	`69cd15e4ed3c9b513adf6b4c9f9e1d2327dd3a66c1b83f3fbc610d5273b27f48`

Algorithm	Hash digest
SHA256	`9cf791929720280e8353bab6125640467b988e3004b58ce14919feb6df674808`
MD5	`8f15bd695986f1a757a8425a5b1df7dd`
BLAKE2b-256	`b6c6221ae6744e5d9d13cae19b581dee445a598b252fe2e7bdcc04fa6ce9b037`

Algorithm	Hash digest
SHA256	`8d4c1862e74adb5dd1ec691c4c758db01c7959c22d81b880db23f4412b896e81`
MD5	`2a90c4c17a55238d1760563386604db9`
BLAKE2b-256	`1a1de39fcd5705aecf85a722f7cd97f845def264c0d1063c4310b87ad7cd2a28`

Algorithm	Hash digest
SHA256	`73cfee7f214a1346fb45fd3e0094ea0f24025f1d2f2ceefe045bc5ee22db8447`
MD5	`35b6204165e67083ce35f58d647a54d8`
BLAKE2b-256	`87171cc69188a708ea146977c608fba7314b97c2701211454259eda7595a9c63`

Algorithm	Hash digest
SHA256	`550d4a041d595d48e304fe8299559a4ef895af1b05286d575adda7dd4d26cbd1`
MD5	`02939294190e03a673a472676c88b962`
BLAKE2b-256	`de818b88ce7dce3b085e3236d8581e7f68d5412f0d93989eeaa266eab01fa1c5`

Algorithm	Hash digest
SHA256	`d25c58293782702f96f450f95bc630a6d4ddfec3ff55160a17f96264d030b6ab`
MD5	`da3a79ca0cab183903a2b6ccf3952449`
BLAKE2b-256	`704d335ba7fb85c7ccc7af0fed814844f9246c2e8490dea9dc39978ab61f1388`

Algorithm	Hash digest
SHA256	`08461abf7d0e719588d84cee6c078f81139782c80e785551c00f3bdf20f4c42a`
MD5	`499c6f7e120b5edb0b1ff299146c0d14`
BLAKE2b-256	`96589109f05b18bbc1a7ac85d3894308e4dafbcb9ccd7ec0d73f937c7ccb2df1`

Algorithm	Hash digest
SHA256	`f36357bb95ab17ca915c8d835d239e41b3407003b248fb681208b6b652750c23`
MD5	`e94a2de361490a6360632c659ef6e096`
BLAKE2b-256	`e7d34ab9e048b6be02e38be1727c73fe51261cf90df71b8e7bfc9d1550b03adc`

Algorithm	Hash digest
SHA256	`afaa974a27baa50d25d564b340d02758c36cb34d638630d332a2fc94b5395c0b`
MD5	`9bf5471850fba4d6f2dc39a28f7cdde6`
BLAKE2b-256	`c2989c3df4c15468c8ba720c6fb07fa2d80b052263762e27d374bb2ea499995c`

lzma-mt 0.2.0

LZMA Multi-Threaded

Installation

Build from source

Usage

Quick start

Drop-in replacement for lzma

All lzma constants are available

Thread parameter

Security

CVE-2025-31115

Memory limits

Thread safety

Performance

API Reference

Functions

Classes

License

Project links

Key dates

1 maintainer

Credits

License expression

Requires

Provides Extra

Tags

Classifiers

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

Algorithm	Hash digest
SHA256	`18355f2e3414d42deb991302ce401928440bb471aa18c08f84f136a5e722396b`
MD5	`fc74e1066eed0c3f98854e78ac9c4fe7`
BLAKE2b-256	`34fd8026c877649f09996465cd43ac6db8cfc73f6be65ba736834a052f5a12fb`

Algorithm	Hash digest
SHA256	`a9ccc79aaf47ef2426ff3a470d903803088493488cb0cf4320ca10759ce09666`
MD5	`4c97aa9f661241ac0317e869b49d303e`
BLAKE2b-256	`679fcdbfa7214a905157219a326a314e912f307c9cdbe96c5cb7e38ba0edad7e`

Algorithm	Hash digest
SHA256	`01c2c0a751dd58ee93eefb09e5e5c7e7a02ffe02c6ae2f62b64d367cb32e87b6`
MD5	`0f2e4e704dc8a7aa8575ba12ceadccd1`
BLAKE2b-256	`46c10707078e5de27aff57521f8fcf29b1002b162d415e7341dc6656fd3da10b`

Algorithm	Hash digest
SHA256	`373c9e2ff7def8de8b0880ccabc014e2459f012b4381f057530b6d804a6e4b13`
MD5	`9d245784cdd977a22e953c7e976345f1`
BLAKE2b-256	`b47f06aceb5b1bc5dec74603433ac0b527b1498eb0e296d1d3ce400411fa09b9`

Algorithm	Hash digest
SHA256	`cc5c11880b2c2ab46d2585b791d40fbc0f9c9f4fa7f22ce345f16011fbe4e34e`
MD5	`92812df16ac40810d616fd5df88ebdd7`
BLAKE2b-256	`0d0f70176479ad6e7d402e062ce84ed440782e316d0165642a3bfda3e74d9883`