zmq-message-patterns 0.1.0

Library to quickly build ZeroMQ based applications.

Library to quickly build ZeroMQ based Python applications.

Introduction

Library to make writing applications using ZeroMQ message patterns through PyZMQ easier.

TODO: explain ZMessage and ZNode classes.

Pipeline

A ventilator sends jobs to multiple worker processes, which send the results to a sink.

Channels:

• ventilator -> worker: jobs for the workers

• ventilator -> sink: IDs of jobs sent to workers, so sink knows if all jobs have completed

• worker -> sink: results

• sink -> worker: sink sends shutdown command, when finished

Diagram:

      ventilator-------------+
          |                  |
  +-------+------+           |
  |       |      |           |
worker worker worker  ...    |
  ||      ||    ||           |
  ++------++----++           |
          ||                 |
         sink----------------+

An is a fully functional example in the examples directory (examples/pipeline_example.py).