imagecodecs 2021.11.20

Image transformation, compression, and decompression codecs

Imagecodecs is a Python library that provides block-oriented, in-memory buffer transformation, compression, and decompression functions for use in the tifffile, czifile, zarr, and other scientific image input/output modules.

Decode and/or encode functions are implemented for Zlib (DEFLATE), GZIP, ZStandard (ZSTD), Blosc, Brotli, Snappy, LZMA, BZ2, LZ4, LZ4F, LZ4HC, LZW, LZF, PGLZ (PostgreSQL LZ), RCOMP (Rice), ZFP, AEC, LERC, NPY, PNG, GIF, TIFF, WebP, JPEG 8-bit, JPEG 12-bit, Lossless JPEG (LJPEG, SOF3), MOZJPEG, JPEG 2000, JPEG LS, JPEG XR (WDP, HD Photo), JPEG XL, AVIF, PackBits, Packed Integers, Delta, XOR Delta, Floating Point Predictor, Bitorder reversal, Bitshuffle, CMS (color space transformations), and Float24 (24-bit floating point).

Author:

Christoph Gohlke

Organization:

Laboratory for Fluorescence Dynamics. University of California, Irvine

License:

BSD 3-Clause

Version:

2021.11.20

Status:

Alpha

Requirements

This release has been tested with the following requirements and dependencies (other versions may work):

• CPython 3.7.9, 3.8.10, 3.9.9, 3.10.0, 64-bit

• Cython 0.29.24

• Numpy 1.21.4

• bitshuffle 0.3.5

• brotli 1.0.9

• brunsli 0.1

• bzip2 1.0.8

• c-blosc 1.21.1

• c-blosc2 2.0.4

• cfitsio 3.49

• charls 2.2.0

• giflib 5.2.1

• jxrlib 1.1

• lcms 2.12

• lerc 3.0

• libaec 1.0.6

• libavif 0.9.3 (aom 3.2.0, dav1d 0.9.2, rav1e 0.4.1)

• libdeflate 1.8

• libjpeg 9d

• libjpeg-turbo 2.1.2

• libjxl 0.6.1

• liblzf 3.6

• liblzma 5.2.5

• libpng 1.6.37

• libspng 0.7.0

• libtiff 4.3.0

• libwebp 1.2.1

• lz4 1.9.3

• mozjpeg 4.0.3

• openjpeg 2.4.0

• snappy 1.1.9

• zfp 0.5.5

• zlib 1.2.11

• zlib-ng 2.0.5

• zopfli-1.0.3

• zstd 1.5.0

Required Python packages for testing (other versions may work):

• tifffile 2021.11.2

• czifile 2019.7.2

• python-blosc 1.10.6

• python-blosc2-0.2.0

• python-brotli 1.0.9

• python-lz4 3.1.3

• python-lzf 0.2.4

• python-snappy 0.6.0

• python-zstd 1.5.0.2

• bitshuffle 0.3.5

• numcodecs 0.9.1

• zarr 2.10.3

• zopflipy 1.7

Notes

This library is largely work in progress.

The API is not stable yet and might change between revisions.

Works on little-endian platforms only.

Python 32-bit versions are deprecated. Python <= 3.6 are no longer supported.

MacOS wheels may not be available for latest releases. Consider using previous, conda-forge or macports releases.

Some codecs are currently decode-only: tiff, lzw, packints, and jpegsof3.

The latest Microsoft Visual C++ Redistributable for Visual Studio 2015-2022 is required on Windows.

Refer to the imagecodecs/licenses folder for 3rd-party library licenses.

This software is based in part on the work of the Independent JPEG Group.

This software includes a modified version of dcm2niix’s jpg_0XC3.cpp.

This software includes a modified version of PostgreSQL’s pg_lzcompress.c.

This software includes a modified version of liblj92.

Build instructions and wheels for manylinux and macOS courtesy of Grzegorz Bokota.

Update pip and setuptools to the latest version before installing imagecodecs:

python -m pip install --upgrade pip setuptools

Install imagecodecs using precompiled wheels:

python -m pip install --upgrade imagecodecs

Install the requirements for building imagecodecs from source code on latest Ubuntu Linux distributions:

sudo apt-get install build-essential python3-dev cython3 python3-setuptools python3-pip python3-wheel python3-numpy python3-zarr python3-pytest python3-blosc python3-brotli python3-snappy python3-lz4 libz-dev libblosc-dev liblzma-dev liblz4-dev libzstd-dev libpng-dev libwebp-dev libbz2-dev libopenjp2-7-dev libjpeg-dev libjxr-dev liblcms2-dev libcharls-dev libaec-dev libbrotli-dev libsnappy-dev libzopfli-dev libgif-dev libtiff-dev libdeflate-dev libavif-dev libcfitsio-dev

Use the --lite build option to only build extensions without 3rd-party dependencies. Use the --skip-extension build options to skip building specific extensions, e.g.:

python -m pip install imagecodecs --global-option="build_ext" --global-option="--skip-bitshuffle"

The jpeg12, jpegls, jpegxl, zfp, avif, lz4f, lerc, mozjpeg, and zlibng extensions are disabled by default when building from source.

To modify other build settings such as library names and compiler arguments, provide a imagecodecs_distributor_setup.customize_build function, which is imported and executed during setup. See setup.py for examples.

Other Python packages and C libraries providing imaging or compression codecs:

• numcodecs

• Python zlib

• Python bz2

• Python lzma

• backports.lzma

• python-lzo

• python-lzw

• python-lerc

• packbits

• isa-l.igzip

• fpzip

• libmng

• APNG patch for libpng

• OpenEXR

• tinyexr

• pytinyexr

• libjpeg (GPL)

• pylibjpeg

• pylibjpeg-libjpeg (GPL)

• pylibjpeg-openjpeg

• pylibjpeg-rle

• glymur

• pyheif

• libheif (LGPL)

• pyrus-cramjam

• QuickLZ (GPL)

• LZO (GPL)

Revisions

2021.11.20

Pass 5949 tests. Fix testing on pypy and Python 3.10.

2021.11.11

Require libjxl 0.6.x. Add CMS codec via Little CMS library for color space transformations (WIP). Add MOZJPEG codec via mozjpeg library (Windows only). Add SPNG codec via libspng library. Rename avif_encode maxthreads parameter to numthreads (breaking). Accept n-dimensional output in non-image numcodecs decoders. Support masks in LERC codec. Support multi-threading and planar format in JPEG2K codec. Support multi-resolution, MCT, bitspersample, and 32-bit in jpeg2k encoder. Change jpeg2k_encode level parameter to fixed quality psnr (breaking). Change jpegxl_encode effort parameter default to minimum 3. Change JPEG encoders to use YCbCr for RGB images by default. Replace lerc_encode planarconfig with planar parameter (breaking). Add option to specify omp numthreads and chunksize in ZFP codec. Set default numthreads to 0. Fix Blosc default typesize. Fix segfault in jpegxl_encode. Replace many constants with enums (breaking).

2021.8.26

Add BLOSC2 codec via c-blosc2 library. Require LERC 3 and libjxl 0.5. Do not exceed literal-only size in PackBits encoder. Raise ImcdError if output is insufficient in PackBits codecs (breaking). Raise ImcdError if input is corrupt in PackBits decoder (breaking). Fix delta codec for non-native byteorder.

2021.7.30

Support more dtypes and axes argument in PackBits encoder. Fix worst case output size in PackBits encoder. Fix decoding AVIF created with older libavif. Fix decoding GIF with disposal to previous for first frame. Add lossless option in jpeg_encode.

2021.6.8

Fix building with Cython 0.3a7. Decode TIFF with JPEG compression, YCBCR or CMYK colorspace as RGB24. Vendor cfitsio/ricecomp.c for shared library builds on Windows (#18).

2021.5.20

Add ZLIBNG codec via zlib-ng library. Add RCOMP (Rice) codec via cfitsio library. Fix decoding of 16-bit JPEG with jpeg_decode. Relax user provided output array shape requirement.

2021.4.28

Change WebP default compression level to lossless. Rename jpegxl codec to brunsli (breaking). Add new JPEG XL codec via jpeg-xl library. Add PGLZ codec via PostgreSQL’s pg_lzcompress.c. Update to libtiff 4.3 and libjpeg-turbo 2.1. Enable JPEG 12-bit codec in manylinux wheels. Drop manylinux2010 wheels.

2021.3.31

Add numcodecs compatible codecs for use by Zarr (experimental). Support separate JPEG header in jpeg_decode. Do not decode JPEG LS and XL in jpeg_decode (breaking). Fix ZFP with partial header. Fix JPEG LS tests (#15). Fix LZ4F contentchecksum. Remove blosc Snappy tests. Fix docstrings.

2021.2.26

Support X2 and X4 floating point predictors (found in DNG).

2021.1.28

Add option to return JPEG XR fixed point pixel types as integers. Add LJPEG codec via liblj92 (alternative to JPEGSOF3 codec). Change zopfli header location.

2021.1.11

Fix build issues (#7, #8). Return bytearray instead of bytes on PyPy. Raise TypeError if output provided is bytes (breaking).

2021.1.8

Add float24 codec. Update copyrights.

2020.12.24

Update dependencies and build scripts.

2020.12.22

Add AVIF codec via libavif. Add DEFLATE/Zlib and GZIP codecs via libdeflate. Add LZ4F codec. Add high compression mode option to lz4_encode. Convert JPEG XR 16 and 32-bit fixed point pixel types to float32. Fix JPEG 2000 lossy encoding. Fix GIF disposal handling. Remove support for Python 3.6 (NEP 29).

2020.5.30

Add LERC codec via ESRI’s lerc library. Enable building JPEG extensions with libjpeg >= 8. Enable distributors to modify build settings.

2020.2.18

Fix segfault when decoding corrupted LZW segments. Work around Cython raises AttributeError when using incompatible numpy. Raise ValueError if in-place decoding is not possible (except floatpred).

2020.1.31

Add GIF codec via giflib. Add TIFF decoder via libtiff. Add codec_check functions. Fix formatting libjpeg error messages. Use xfail in tests. Load extensions on demand on Python >= 3.7. Add build options to skip building specific extensions. Split imagecodecs extension into individual extensions. Move shared code into shared extension. Rename imagecodecs_lite extension and imagecodecs C library to ‘imcd’. Remove support for Python 2.7 and 3.5.

2019.12.31

Fix decoding of indexed PNG with transparency. Last version to support Python 2.7 and 3.5.

2019.12.16

Add Zopfli codec. Add Snappy codec. Rename j2k codec to jpeg2k. Rename jxr codec to jpegxr. Use Debian’s jxrlib. Support pathlib and binary streams in imread and imwrite. Move external C declarations to pxd files. Move shared code to pxi file. Update copyright notices.

2019.12.10

Add version functions. Add Brotli codec. Add optional JPEG XL codec via Brunsli repacker.

2019.12.3

Sync with imagecodecs-lite.

2019.11.28

Add AEC codec via libaec. Do not require scikit-image for testing. Require CharLS 2.1.

2019.11.18

Add bitshuffle codec. Fix formatting of unknown error numbers. Fix test failures with official python-lzf.

2019.11.5

Rebuild with updated dependencies.

2019.5.22

Add optional YCbCr chroma subsampling to JPEG encoder. Add default reversible mode to ZFP encoder. Add imread and imwrite helper functions.

2019.4.20

Fix setup requirements.

2019.2.22

Move codecs without 3rd-party C library dependencies to imagecodecs_lite.

2019.2.20

Rebuild with updated dependencies.

2019.1.20

Add more pixel formats to JPEG XR codec. Add JPEG XR encoder.

2019.1.14

Add optional ZFP codec via zfp library. Add numpy NPY and NPZ codecs. Fix some static codechecker errors.

2019.1.1

…

Refer to the CHANGES file for older revisions.