Skip to main content

Add Zstandard compression/decompression functionality for joblib

Project description

joblib-zstd is a plugin, which enables Zstandard (.zst) compression and decompression through joblib.dump and joblib.load.

Prerequisites

You need joblib.

Install

pip install joblib-zstd

If you failed to install, update version of pip and setuptools:

pip install -U pip setuptools

Usage

import joblib
import joblib_zstd
joblib_zstd.register()

joblib.dump({'a': 1, 'b': 2}, 'obj.zst', compress=5)  # implicit compression
joblib.dump({'a': 1, 'b': 2}, 'obj.bin', compress=('zstd', 5))  # explicit compression

joblib.load('obj.zst')  # implicit decompression

LISENCE

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

joblib-zstd-0.1.1.tar.gz (2.7 kB view details)

Uploaded Source

Built Distribution

joblib_zstd-0.1.1-py3-none-any.whl (3.0 kB view details)

Uploaded Python 3

File details

Details for the file joblib-zstd-0.1.1.tar.gz.

File metadata

  • Download URL: joblib-zstd-0.1.1.tar.gz
  • Upload date:
  • Size: 2.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.8.0 Darwin/18.7.0

File hashes

Hashes for joblib-zstd-0.1.1.tar.gz
Algorithm Hash digest
SHA256 877e94edc305d1c204e50f8d9f790c25ff8a3bde09074eee7af22f082979046b
MD5 0ce4dcadd15556b395a8facf7a94846e
BLAKE2b-256 447d820cc73df3568f56402cc39231ec7a6ff907644e5e78dabc7705a09c8ce3

See more details on using hashes here.

File details

Details for the file joblib_zstd-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: joblib_zstd-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 3.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.8.0 Darwin/18.7.0

File hashes

Hashes for joblib_zstd-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 996b937b415807d62d7541a81b9287f27337481d43a31403135bf5dc1b6145db
MD5 284c8b76a8c2c02392b61e20d1b865f1
BLAKE2b-256 806f1a2cd753b314b8c21c0d3616236e6eadd4ae0813e3d1047338d23dea409c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page