Skip to main content

extended pickle

Project description

Extends the original Pickler class to be able to pickle some otherwise non-supported types. The emphasis is to be fast and for communication via pipes/sockets with the same Python version on the other end - thus we don’t care that much for compatibility with other versions.

A similar project is dill, which is much bigger though.

This project is registered on PyPI and can be installed via

pip install extpickle

For some usage examples, see the test code.

Over the base Pickler class, it adds pickling support for:

  • types.FunctionType, types.CodeType and cell-types. I.e. you can pickle lamdas and functions. Note this will use the marshal module for the byte-code, so this is not portable across different Python versions.

  • Modules. This is done by referencing it via its name. Note that is has some extra handling for __main__, which is allowed to be a different module.

  • mod.__dict__ where mod is a module is also stored just as a reference to the module, not a copy of the dict.

  • (Python 2) buffer.

  • numpy.ndarray. This is also supported by the base class but our implementation is much faster. Actually this is a bit weird because the default implementation should also be just as fast but it isn’t. Our implementation basically just uses fromstring/tostring.

  • New-style classes. The base class would try to look them up in a module. This will fail whenever it cannot be find in such namespace. Our implementation, if that fails, will actually store the information to construct a new class, i.e. the name, the bases and its dict.

  • (Python 2) Old-style classes. This is the same behavior as for the new-style classes.

This was used in the TaskSystem project.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

extpickle-1.20160617.170648.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

extpickle-1.20160617.170648-py2.py3-none-any.whl (7.5 kB view details)

Uploaded Python 2Python 3

File details

Details for the file extpickle-1.20160617.170648.tar.gz.

File metadata

File hashes

Hashes for extpickle-1.20160617.170648.tar.gz
Algorithm Hash digest
SHA256 6cd47b146e907285b678e03d3ec2040fbfcad21a2a4936617a9216f3f8d7bd13
MD5 e30d0d52e1e7cbc6e1632de75bd4059b
BLAKE2b-256 f17427ca8ec15a1c6fff167120f61972ab649ee56d68bdc516d11a8549cd9058

See more details on using hashes here.

File details

Details for the file extpickle-1.20160617.170648-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for extpickle-1.20160617.170648-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 e1fb36ca0e0a8b19b7873ae44a75276f87aae5784d211e7fd5414aded8d8516a
MD5 97483948a65b842502ad7e189012c77d
BLAKE2b-256 4a5ef6bf1a57c19b3318cd9065dcafd952fd97ed850dad082af9dae12cbb3f89

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page