Skip to main content

Standard pickle, wrapped with standard compression libraries

Project description

compress_pickle

Standard python pickle, thinly wrapped with standard compression libraries

Code style: black Build Status Coverage Status PyPI License: MIT

The standard pickle package provides an excellent default tool for serializing arbitrary python objects and storing them to disk. Standard python also includes broad set of data compression packages. compress_pickle provides an interface to the standard pickle.dump, pickle.load, pickle.dumps and pickle.loads functions, but wraps them in order to direct the serialized data through one of the standard compression packages. This way you can seemlessly serialize data to disk or to any file-like object in a compressed way.

compress_pickle is built and tested in python >= 3.5

Supported compression protocols:

  • gzip
  • bz2
  • lzma
  • zipfile (Note that python3.6 and higher allows to build a file-like buffer into the zip archive, which allows us to use less memory than in python3.5)

Furthermore, compress_pickle supports the lz4 compression protocol, that isn't part of the standard python compression packages. This is provided as an optional extra requirement that can be installed as:

pip install compress_pickle[lz4]

Please refer to the package's documentation for more information

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for compress-pickle, version 1.1.1
Filename, size File type Python version Upload date Hashes
Filename, size compress_pickle-1.1.1-py3-none-any.whl (10.1 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size compress_pickle-1.1.1.tar.gz (9.2 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page