Skip to main content

Python pickling and marshal protocol over any network interface.

Project description


.. image::
:alt: Linux and MacOS Build Status
.. image::
:alt: Windows Build Status
.. image::
:alt: Test Suite Coverage
.. image::
:alt: Code Health
.. image::
:alt: Documentation Build Status
.. image::
:alt: Dependency Versions
.. image::
:alt: PyPI Version
.. image::
:alt: Say Thanks to the Maintainers

Python pickling protocol over any network interface. Also provides a basic interface to implement your own serializing pipes.

This project was started and released in under 24 hours while I was on holiday break.

Getting Started with PicklePipe

PicklePipe is available on PyPI can be installed with `pip <>`_.::

$ python -m pip install picklepipe

To install the latest development version from `Github <>`_::

$ python -m pip install git+git://

If your current Python installation doesn't have pip available, try ` <>`_

After installing PicklePipe you can use it like any other Python module.
Here's a very simple demonstration of scheduling a single job on a farm.

.. code-block:: python

import picklepipe

# Create a pair of connected pipes.
pipe1, pipe2 = picklepipe.make_pipe_pair(picklepipe.PicklePipe)

# Send an object in one end.
pipe1.send_object('Hello, world!')

# And retrieve it from the other.
obj = pipe2.recv_object(timeout=1.0)

assert obj == 'Hello, world!'

# Also can be used to send objects to remote locations!
import socket
sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
sock.connect(('host', 12345))
pipe = picklepipe.PicklePipe(sock)
pipe.send_object('Hello, world!')

API Reference

The `API Reference on <>`_ provides API-level documentation.

Support / Report Issues

All support requests and issue reports should be
`filed on Github as an issue <>`_.
Make sure to follow the template so your request may be as handled as quickly as possible.
Please respect contributors by not using personal contacts for support requests.


We happily welcome contributions, please see `our guide for Contributors <>`_ for the best places to start and help.


PicklePipe is made available under the MIT License. For more details, see `LICENSE.txt <>`_.



* (Add feature or bug fix along with author.)

Release 1.1.0 (December 29, 2016)

* Create the :class:`picklepipe.JSONPipe` for serializing JSON data.

Release 1.0.0 (December 28, 2016)
* Create initial implementation of :class:`picklepipe.PicklePipe`.
* Create :meth:`picklepipe.make_pipe_pair` to create a connected pair of :class:`picklepipe.PicklePipe` instances.
* Added support for creating own serialization pipes with :class:`picklepipe.BaseSerializationPipe`.
* Added support for the ``marshal`` object serializer with :class:`picklepipe.MarshalPipe`
* :class:`picklepipe.PicklePipe` now uses ``cPickle`` module if available.
* Make all pipe types selectable using selectors.
* Add the ``max_size`` attribute for limiting memory usage of pipes.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for picklepipe, version 1.1.1
Filename, size File type Python version Upload date Hashes
Filename, size picklepipe-1.1.1-py2.py3-none-any.whl (12.6 kB) File type Wheel Python version 3.5 Upload date Hashes View
Filename, size picklepipe-1.1.1.tar.gz (16.6 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page