Skip to main content

Python-Blosc2

A fast & compressed ndarray library with a flexible compute engine

Author:

The Blosc development team

Contact:

blosc@blosc.org

Github:

https://github.com/Blosc/python-blosc2

Actions:

actions

PyPi:

version

NumFOCUS:

numfocus

Code of Conduct:

Contributor Covenant

What is Python-Blosc2?

Python-Blosc2 is a high-performance compressor, compute engine, and format for binary data containers that are portable and open-source. It comes with a lazy expression engine allowing for complex calculations on compressed data, whether stored in memory, on disk, or over the network (e.g., via Caterva2). It is especially optimized for storing and retrieving data from N-dimensional arrays (NDArray) and columnar tables (CTable), complemented by a query/indexing layer. The main use case is fast, compressed, out-of-core numerical data — especially when data is too large to fit comfortably in RAM.

C-Blosc2 is used under the hood as its compression backend. Written in C, and building on its predecessor C-Blosc, C-Blosc2 aims to be an extremely fast meta-compressor for binary data, supporting a diverse set of strategies, and with an extensible plugin architecture for a wide range of codecs and filters.

miniexpr is embedded as the compute engine backend. It delivers fast multithreaded evaluation for lazy expressions directly over compressed chunks, and powers Menudet, a little language for portable, JIT-accelerated array (and table columns) kernels that can be serialized on a architecture-independent way.

More info: https://www.blosc.org/python-blosc2/getting_started/overview.html

Installing

Binary packages are available for major OSes (Win, Mac, Linux) and platforms. Install from PyPI using pip:

pip install blosc2 --upgrade

Conda users can install from conda-forge:

conda install -c conda-forge python-blosc2

Python-Blosc2 4.16 requires C-Blosc2 3.7.0 or newer. Wheels bundle the native library; source builds using USE_SYSTEM_BLOSC2 must provide compatible headers and libraries.

Command line tools

Two CLI tools are installed along with the package:

  • b2view: an interactive terminal browser (TUI) for TreeStore bundles (.b2d directories or .b2z files), with paged views of NDArray and CTable data of any size (walkthrough; requires pip install "blosc2[tui]").

  • parquet-to-blosc2: converts Parquet files to Blosc2 columnar table stores, and back (walkthrough; requires pip install "blosc2[parquet]").

Documentation

The documentation is available here:

https://blosc.org/python-blosc2/python-blosc2.html

You can find examples at:

https://github.com/Blosc/python-blosc2/tree/main/examples

A tutorial from PyData Global 2025 is available at:

https://github.com/Blosc/PyData-Global-2025-Tutorial

(Click here to watch the video recording of the tutorial)

It contains Jupyter notebooks explaining the main features of Python-Blosc2.

License

This software is licensed under a 3-Clause BSD license. A copy of the python-blosc2 license can be found in LICENSE.txt.

Discussion forum

Discussion about this package is welcome at:

https://github.com/Blosc/python-blosc2/discussions

Social feeds

Stay informed about the latest developments by following us in Mastodon, Bluesky or LinkedIn.

Thanks

Blosc2 is supported by the NumFOCUS foundation, the LEAPS-INNOV project and ironArray SLU, among many other donors. This allowed the following people to have contributed in an important way to the core development of the Blosc2 library:

  • Francesc Alted

  • Marta Iborra

  • Luke Shaw

  • Aleix Alcacer

  • Oscar Guiñón

  • Juan David Ibáñez

  • Ivan Vilata i Balaguer

  • Oumaima Ech.Chdig

  • Ricardo Sales Piquer

In addition, other people have participated in the project in different aspects:

  • Jan Sellner, contributed the mmap support for NDArray/SChunk objects.

  • Dimitri Papadopoulos, contributed a large bunch of improvements to many aspects of the project. His attention to detail is remarkable.

  • And many others that have contributed with bug reports, suggestions and improvements.

Developed using JetBrains IDEs.

JetBrains logo.

Citing Blosc

You can cite our work on the various libraries under the Blosc umbrella as follows:

@ONLINE{blosc,
  author = {{Blosc Development Team}},
  title = "{A fast, compressed and persistent data store library}",
  year = {2009-2026},
  note = {https://blosc.org}
}

Support Blosc for a Sustainable Future

If you find Blosc useful and want to support its development, please consider making a donation or contract to the Blosc Development Team. Thank you!

Compress Better, Compute Bigger

Metadata

Release files for blosc2 4.16.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for blosc2 4.16.0
File Interpreter ABI Platform Actions
blosc2-4.16.0-cp311-abi3-macosx_10_9_x86_64.whl CPython 3.11 abi3 macOS 10.9+ x86-64 Details for blosc2-4.16.0-cp311-abi3-macosx_10_9_x86_64.whl

Release files / blosc2-4.16.0-cp311-abi3-macosx_10_9_x86_64.whl

Download URL blosc2-4.16.0-cp311-abi3-macosx_10_9_x86_64.whl
Size 6.7 MB
Tags CPython 3.11 abi3 macOS 10.9+ x86-64
SHA-256 checksum
How to use checksums
e74eb9e516848282bd8bfca85369aafa1ef8ec181ea30114ddb0cdfdd320f5fe
BLAKE2b-256 checksum
How to use checksums
26d4fb498b745240e9fee07dbafd618b85725fafb8b8114bf47989daa3adbe29
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Security for blosc2 4.16.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

4.16.0 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page