Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (
Help us improve Python packaging - Donate today!

better multiprocessing and multithreading in python

Project Description

About Multiprocess

multiprocess is a fork of multiprocessing, and is developed as part of pathos:

Multiprocessing is a package for the Python language which supports the spawning of processes using the API of the standard library’s threading module. multiprocessing has been distributed in the standard library since python 2.6.


  • Objects can be transferred between processes using pipes or multi-producer/multi-consumer queues.
  • Objects can be shared between processes using a server process or (for simple data) shared memory.
  • Equivalents of all the synchronization primitives in threading are available.
  • A Pool class makes it easy to submit tasks to a pool of worker processes.

Pathos is a python framework for heterogeneous computing. Pathos is in active development, so any user feedback, bug reports, comments, or suggestions are highly appreciated. A list of known issues is maintained at, with a public ticket list at

NOTE: A C compiler is required to build the included extension module. For python 3.3 and above, a C compiler is suggested, but not required.

Major Changes

  • enhanced serialization, using dill

Current Release

This version is multiprocess-0.70.5 (a fork of multiprocessing-0.70a1).

The latest released pathos fork of multiprocessing is available from:

Multiprocessing is distributed under a BSD license.

Development Version

You can get the latest development version with all the shiny new features at:

If you have a new contribution, please submit a pull request.


Multiprocess is packaged to install from source, so you must download the tarball, unzip, and run the installer:

$ tar -xvzf multiprocess-0.70.5.tgz
$ cd multiprocess-0.70.5
$ python build
$ python install

You will be warned of any missing dependencies and/or settings after you run the “build” step above.

Alternately, multiprocess can be installed with pip or easy_install:

$ pip install multiprocess

NOTE: A C compiler is required to build the included extension module. For python 3.3 and above, a C compiler is suggested, but not required.


Multiprocess requires:

- python2, version >= 2.5  *or*  python3, version >= 3.1

Optional requirements:

- setuptools, version >= 0.6
- dill, version >= 0.2.6

More Information

Probably the best way to get started is to look at the examples that are provided within multiprocess. See the examples directory for a set of example scripts. Please feel free to submit a ticket on github, or ask a question on stackoverflow (@Mike McKerns).

Pathos is an active research tool. There are a growing number of publications and presentations that discuss real-world examples and new features of pathos in greater detail than presented in the user’s guide. If you would like to share how you use pathos in your work, please post a link or send an email (to mmckerns at uqfoundation dot org).


If you use pathos to do research that leads to publication, we ask that you acknowledge use of pathos by citing the following in your publication:

M.M. McKerns, L. Strand, T. Sullivan, A. Fang, M.A.G. Aivazis,
"Building a framework for predictive science", Proceedings of
the 10th Python in Science Conference, 2011;

Michael McKerns and Michael Aivazis,
"pathos: a framework for heterogeneous computing", 2010- ;

Please see or for further information.

Release History

Release History

This version
History Node


History Node


History Node


History Node


History Node


History Node


Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date (1.5 MB) Copy SHA256 Checksum SHA256 Source Feb 1, 2017

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting