Skip to main content

ZooParallel Logo

High-Performance Multiprocessing Primitives for Python, written in Rust

ZooParallel provides robust, crash-safe, and zero-copy synchronization primitives backed by Shared Memory (POSIX shm) and Linux Futexes.

📖 User Guide

🚀 Usage Examples

Install

pip install zooparallelmp

or with uv:

uv add zooparallelmp

Process Pool

from zooparallel import ZooPool

# 8x faster than ProcessPoolExecutor for small tasks
with ZooPool(num_workers=4) as pool:
    # Processing data in parallel with zero IPC overhead
    results = pool.map(lambda x: x*x, range(100))

Lock (Crash-Safe)

from zooparallel import ZooLock, LockRecovered

# If a process kills -9 while holding this, the next one recovers it!
lock = ZooLock("my_db_lock")

try:
    with lock:
        # Critical Section
        pass
except LockRecovered:
    print("Previous owner died! State recovered.")

Zero-Copy Queue

from zooparallel import ZooQueue

# Ring Buffer in Shared Memory
q = ZooQueue("video_stream", size_mb=100)

# Producer
q.put_bytes(b"frame_data")

# Consumer (Zero-Copy View)
view, cursor = q.recv_view()
# process 'view' directly without copying...
q.commit_read(cursor)

💡 When to use ZooParallel?

✅ Use ZooParallel when... ❌ Stick to multiprocessing when...
You need high throughput (GB/s) between processes. You are sending small, infrequent messages.
You are working with large data like Video Frames or Numpy Arrays. You need to support Windows.
You require latency < 1ms for IPC. You prefer pure Python standard libraries without binary extensions.
You need crash-safety (if a worker dies, the lock is released). You need dynamic buffer resizing (ZooQueue is fixed-size).

📚 Documentation

Guides

  • User Guide: Getting started and common patterns.
  • Adapters: Integration with Numpy, PyArrow, and Protobuf.

Features

📊 Benchmarks

Results from a MacBook Pro M1 8GB RAM (2020):

Benchmark multiprocessing ZooParallel Speedup
Lock Contention 281k ops/s 1.22M ops/s 4.3x
Queue Throughput 4.1 GB/s 32.6 GB/s 7.9x
Pool Overhead 14k tasks/s 114k tasks/s 8.1x

Architecture (ADRs)

Compatibility

[!WARNING] macOS/Windows: Crash recovery (resiliency against dead processes) relies on Robust Mutexes, which are only supported on Linux. On macOS, if a worker process crashes while holding a lock, the system will deadlock. Use with caution in production on non-Linux platforms. Note that ZooPool monitors and restarts crashed workers, but this cannot recover a deadlocked synchronization primitive.

OS Lock Queue Pool Crash Recovery
Linux
macOS
Windows

License

MIT

Release files for zooparallel 2026.2.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for zooparallel 2026.2.2
File Size Uploaded
zooparallel-2026.2.2.tar.gz 42.6 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for zooparallel 2026.2.2
File
zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ x86-64 Details
zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ ARM64 Details
zooparallel-2026.2.2-cp313-cp313-macosx_11_0_arm64.whl CPython 3.13 CPython 3.13 macOS 11.0+ ARM64 Details
zooparallel-2026.2.2-cp313-cp313-macosx_10_12_x86_64.whl CPython 3.13 CPython 3.13 macOS 10.12+ x86-64 Details
zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64 Details
zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ ARM64 Details
zooparallel-2026.2.2-cp312-cp312-macosx_11_0_arm64.whl CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details
zooparallel-2026.2.2-cp312-cp312-macosx_10_12_x86_64.whl CPython 3.12 CPython 3.12 macOS 10.12+ x86-64 Details
zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ x86-64 Details
zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_aarch64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ ARM64 Details
zooparallel-2026.2.2-cp311-cp311-macosx_11_0_arm64.whl CPython 3.11 CPython 3.11 macOS 11.0+ ARM64 Details
zooparallel-2026.2.2-cp311-cp311-macosx_10_12_x86_64.whl CPython 3.11 CPython 3.11 macOS 10.12+ x86-64 Details
zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_x86_64.whl CPython 3.10 CPython 3.10 Linux glibc 2.28+ x86-64 Details
zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_aarch64.whl CPython 3.10 CPython 3.10 Linux glibc 2.28+ ARM64 Details
zooparallel-2026.2.2-cp310-cp310-macosx_11_0_arm64.whl CPython 3.10 CPython 3.10 macOS 11.0+ ARM64 Details
zooparallel-2026.2.2-cp310-cp310-macosx_10_12_x86_64.whl CPython 3.10 CPython 3.10 macOS 10.12+ x86-64 Details

Total release size: 3.4 MB

Release files / zooparallel-2026.2.2.tar.gz

Download URL zooparallel-2026.2.2.tar.gz
Size 42.6 kB
Tags Source
SHA-256 checksum
How to use checksums
e3bc8ada4a83cfe771ed86022800d3248a67fdef7ed3261a8320e00774f13603
BLAKE2b-256 checksum
How to use checksums
740e699ca9bbb3bb2c76c17b3ed947114cf4a537e0a21c1d02ac02195897456d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_x86_64.whl

Download URL zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_x86_64.whl
Size 223.9 kB
Tags CPython 3.13 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
72ab7a7c27b41bd519309e56865ba0267bcdaedabd9591157f7574bc45b84cbc
BLAKE2b-256 checksum
How to use checksums
cba3d045ee967abfc921618396bf7fc088a5c14e9c8d1eb762b70472eac9549b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_aarch64.whl

Download URL zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_aarch64.whl
Size 216.8 kB
Tags CPython 3.13 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
f971031b2e367a563dde69d434607fd2142511d2d6ec8c4955a305b6c494776b
BLAKE2b-256 checksum
How to use checksums
4d6ec22d56094e420d70b55d0c36887f21efad9ad06cbad74ee9c4918ad76336
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp313-cp313-macosx_11_0_arm64.whl

Download URL zooparallel-2026.2.2-cp313-cp313-macosx_11_0_arm64.whl
Size 199.0 kB
Tags CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
cb9da09ad9f829b27324049b264d2c1ce17d3cd99fda564abb4fd82b748d6123
BLAKE2b-256 checksum
How to use checksums
19aac54035c849a35d84b3be3b79dc0847076fb7044ee87a2abf133d7836f84b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp313-cp313-macosx_10_12_x86_64.whl

Download URL zooparallel-2026.2.2-cp313-cp313-macosx_10_12_x86_64.whl
Size 210.5 kB
Tags CPython 3.13 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
ceedbd7ff8f79fd21e780ed0c8e80d1dc50c7ed46e9076be544c71c216838875
BLAKE2b-256 checksum
How to use checksums
22f1fce1e74840bc232e51573a5df8874bca9fcf90f08fd74f9b7f9d7b7e1fb6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_x86_64.whl

Download URL zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_x86_64.whl
Size 224.1 kB
Tags CPython 3.12 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
27265fb02c649e5c34a3f3274b04c583d6978190b166ead515b95025498a4c58
BLAKE2b-256 checksum
How to use checksums
62507bf14c02ce73a495159214805b12a66c043142973dc37a4e6e8de0ef0715
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_aarch64.whl

Download URL zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_aarch64.whl
Size 216.9 kB
Tags CPython 3.12 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
c7dd9561c3823509956e46aa603f79260a1fc21c3512c7bfeb6b46eb65c3211d
BLAKE2b-256 checksum
How to use checksums
1d559606deecf0556a4ad454b70ca1a1083a5bae5f19a2d5694fe599bc2754fd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp312-cp312-macosx_11_0_arm64.whl

Download URL zooparallel-2026.2.2-cp312-cp312-macosx_11_0_arm64.whl
Size 199.0 kB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
5a4e60f2e6931d4c4bf51d63288303177d1612bf430f18d9bc9ea5a506e4f686
BLAKE2b-256 checksum
How to use checksums
e7977686c543eb5d87862ecc954bb2fc05c78c83579940e942cd33ba357c4f2d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp312-cp312-macosx_10_12_x86_64.whl

Download URL zooparallel-2026.2.2-cp312-cp312-macosx_10_12_x86_64.whl
Size 210.5 kB
Tags CPython 3.12 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
f2395980366168b651d559e4d3f57596710e41c1678c94269ad4839667489523
BLAKE2b-256 checksum
How to use checksums
cefe9823e561cafd0f52503fcbda22f23e20302e3de6cdebaaafffc0e4940d86
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_x86_64.whl

Download URL zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_x86_64.whl
Size 224.0 kB
Tags CPython 3.11 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
7049d885ea64f23bc33d49adcb97284b88f555ca05ff17c28979f0654c6f8cff
BLAKE2b-256 checksum
How to use checksums
5d315bedeedf799c2b7aa893792648dfb09971a844c3ce6dafbe660d6748ea2b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_aarch64.whl

Download URL zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_aarch64.whl
Size 217.7 kB
Tags CPython 3.11 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
853f0f5d9ee36272b6d44935f11232a33a2a146b3a254b1f0801d51d3689226d
BLAKE2b-256 checksum
How to use checksums
f2ca4c1fd8f2000266babb711b2a58cac7435e9858ea1250173f1299e41fc2ff
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp311-cp311-macosx_11_0_arm64.whl

Download URL zooparallel-2026.2.2-cp311-cp311-macosx_11_0_arm64.whl
Size 198.9 kB
Tags CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
37ece87233c270c2d06bb7c1f18d0de5b1815f10972f0f8ce39fe8cf76c594ef
BLAKE2b-256 checksum
How to use checksums
9551309089b3b5c8ad9613e35caee98355043a99fc57cff7c82404c60f051c61
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp311-cp311-macosx_10_12_x86_64.whl

Download URL zooparallel-2026.2.2-cp311-cp311-macosx_10_12_x86_64.whl
Size 210.1 kB
Tags CPython 3.11 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
bbb891f6201a654d897448d366ad8318c48a4a23e98c610d412d57acefbb25db
BLAKE2b-256 checksum
How to use checksums
7600accd4f742565dc620bf50afe013ebaebd9f0e18207f6d15f01c5aca32dd7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_x86_64.whl

Download URL zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_x86_64.whl
Size 224.2 kB
Tags CPython 3.10 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
fd6fa8a6ae9a0f85910b21f0fb1ae666c89bfb281add5f16b8b4a4ee627bd488
BLAKE2b-256 checksum
How to use checksums
4c66fab60c4fb3a43cbc02c9c6ff76f99df6cc3024435fda17d460acbc9ef4c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_aarch64.whl

Download URL zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_aarch64.whl
Size 217.9 kB
Tags CPython 3.10 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
752d17ccb0855818a4d94ed057dd0fcb6b16249056c2f1ec390d852d8978e67e
BLAKE2b-256 checksum
How to use checksums
e33011b14778bff761a2dca79b3ea282a5b5e5e1cce88a94381d9918116fec1a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp310-cp310-macosx_11_0_arm64.whl

Download URL zooparallel-2026.2.2-cp310-cp310-macosx_11_0_arm64.whl
Size 199.3 kB
Tags CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
599848735518441d253793bc24fa33f5a302b7fc32aa11da85d1bfa5be72c3ba
BLAKE2b-256 checksum
How to use checksums
1a4749a2432a8a2301cf98555d770c08fd8ce5f79ff375bd77ec7bb542dcc1b0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release files / zooparallel-2026.2.2-cp310-cp310-macosx_10_12_x86_64.whl

Download URL zooparallel-2026.2.2-cp310-cp310-macosx_10_12_x86_64.whl
Size 210.4 kB
Tags CPython 3.10 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
c836470ddda3f956b4a04434b62c2633a5e1ecf2a0e05b5d8459c9f247739052
BLAKE2b-256 checksum
How to use checksums
723f5c7073cba5aa0bd649cb0c01980e8d8fd74885685f9bcbbd42d723a15d4e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

2026.2.2 This release

17 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page