High-Performance Multiprocessing Primitives for Python, written in Rust
ZooParallel provides robust, crash-safe, and zero-copy synchronization primitives backed by Shared Memory (POSIX shm) and Linux Futexes.
🚀 Usage Examples
Install
pip install zooparallelmp
or with uv:
uv add zooparallelmp
Process Pool
from zooparallel import ZooPool
# 8x faster than ProcessPoolExecutor for small tasks
with ZooPool(num_workers=4) as pool:
# Processing data in parallel with zero IPC overhead
results = pool.map(lambda x: x*x, range(100))
Lock (Crash-Safe)
from zooparallel import ZooLock, LockRecovered
# If a process kills -9 while holding this, the next one recovers it!
lock = ZooLock("my_db_lock")
try:
with lock:
# Critical Section
pass
except LockRecovered:
print("Previous owner died! State recovered.")
Zero-Copy Queue
from zooparallel import ZooQueue
# Ring Buffer in Shared Memory
q = ZooQueue("video_stream", size_mb=100)
# Producer
q.put_bytes(b"frame_data")
# Consumer (Zero-Copy View)
view, cursor = q.recv_view()
# process 'view' directly without copying...
q.commit_read(cursor)
💡 When to use ZooParallel?
| ✅ Use ZooParallel when... | ❌ Stick to multiprocessing when... |
|---|---|
| You need high throughput (GB/s) between processes. | You are sending small, infrequent messages. |
| You are working with large data like Video Frames or Numpy Arrays. | You need to support Windows. |
| You require latency < 1ms for IPC. | You prefer pure Python standard libraries without binary extensions. |
| You need crash-safety (if a worker dies, the lock is released). | You need dynamic buffer resizing (ZooQueue is fixed-size). |
📚 Documentation
Guides
- User Guide: Getting started and common patterns.
- Adapters: Integration with Numpy, PyArrow, and Protobuf.
Features
- Robust Locks: Crash-safe mutexes that recover from dead workers.
- Zero-Copy Queues: high-throughput IPC ring buffers.
- ZooPool: High-performance process pool.
📊 Benchmarks
Results from a MacBook Pro M1 8GB RAM (2020):
| Benchmark | multiprocessing |
ZooParallel |
Speedup |
|---|---|---|---|
| Lock Contention | 281k ops/s | 1.22M ops/s | 4.3x |
| Queue Throughput | 4.1 GB/s | 32.6 GB/s | 7.9x |
| Pool Overhead | 14k tasks/s | 114k tasks/s | 8.1x |
Architecture (ADRs)
Compatibility
[!WARNING] macOS/Windows: Crash recovery (resiliency against dead processes) relies on Robust Mutexes, which are only supported on Linux. On macOS, if a worker process crashes while holding a lock, the system will deadlock. Use with caution in production on non-Linux platforms. Note that
ZooPoolmonitors and restarts crashed workers, but this cannot recover a deadlocked synchronization primitive.
| OS | Lock | Queue | Pool | Crash Recovery |
|---|---|---|---|---|
| Linux | ✅ | ✅ | ✅ | ✅ |
| macOS | ✅ | ✅ | ✅ | ❌ |
| Windows | ❌ | ❌ | ❌ | ❌ |
License
MIT
Release files for zooparallel 2026.2.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| zooparallel-2026.2.2.tar.gz | 42.6 kB | Details |
Built distributions (wheels)
Total release size: 3.4 MB
Release files / zooparallel-2026.2.2.tar.gz
| Download URL | zooparallel-2026.2.2.tar.gz |
|---|---|
| Size | 42.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e3bc8ada4a83cfe771ed86022800d3248a67fdef7ed3261a8320e00774f13603
|
|
BLAKE2b-256 checksum How to use checksums |
740e699ca9bbb3bb2c76c17b3ed947114cf4a537e0a21c1d02ac02195897456d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 223.9 kB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
72ab7a7c27b41bd519309e56865ba0267bcdaedabd9591157f7574bc45b84cbc
|
|
BLAKE2b-256 checksum How to use checksums |
cba3d045ee967abfc921618396bf7fc088a5c14e9c8d1eb762b70472eac9549b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_aarch64.whl
| Download URL | zooparallel-2026.2.2-cp313-cp313-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 216.8 kB |
| Tags | CPython 3.13 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
f971031b2e367a563dde69d434607fd2142511d2d6ec8c4955a305b6c494776b
|
|
BLAKE2b-256 checksum How to use checksums |
4d6ec22d56094e420d70b55d0c36887f21efad9ad06cbad74ee9c4918ad76336
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp313-cp313-macosx_11_0_arm64.whl
| Download URL | zooparallel-2026.2.2-cp313-cp313-macosx_11_0_arm64.whl |
|---|---|
| Size | 199.0 kB |
| Tags | CPython 3.13 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
cb9da09ad9f829b27324049b264d2c1ce17d3cd99fda564abb4fd82b748d6123
|
|
BLAKE2b-256 checksum How to use checksums |
19aac54035c849a35d84b3be3b79dc0847076fb7044ee87a2abf133d7836f84b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp313-cp313-macosx_10_12_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp313-cp313-macosx_10_12_x86_64.whl |
|---|---|
| Size | 210.5 kB |
| Tags | CPython 3.13 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
ceedbd7ff8f79fd21e780ed0c8e80d1dc50c7ed46e9076be544c71c216838875
|
|
BLAKE2b-256 checksum How to use checksums |
22f1fce1e74840bc232e51573a5df8874bca9fcf90f08fd74f9b7f9d7b7e1fb6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 224.1 kB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
27265fb02c649e5c34a3f3274b04c583d6978190b166ead515b95025498a4c58
|
|
BLAKE2b-256 checksum How to use checksums |
62507bf14c02ce73a495159214805b12a66c043142973dc37a4e6e8de0ef0715
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_aarch64.whl
| Download URL | zooparallel-2026.2.2-cp312-cp312-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 216.9 kB |
| Tags | CPython 3.12 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
c7dd9561c3823509956e46aa603f79260a1fc21c3512c7bfeb6b46eb65c3211d
|
|
BLAKE2b-256 checksum How to use checksums |
1d559606deecf0556a4ad454b70ca1a1083a5bae5f19a2d5694fe599bc2754fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp312-cp312-macosx_11_0_arm64.whl
| Download URL | zooparallel-2026.2.2-cp312-cp312-macosx_11_0_arm64.whl |
|---|---|
| Size | 199.0 kB |
| Tags | CPython 3.12 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
5a4e60f2e6931d4c4bf51d63288303177d1612bf430f18d9bc9ea5a506e4f686
|
|
BLAKE2b-256 checksum How to use checksums |
e7977686c543eb5d87862ecc954bb2fc05c78c83579940e942cd33ba357c4f2d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp312-cp312-macosx_10_12_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp312-cp312-macosx_10_12_x86_64.whl |
|---|---|
| Size | 210.5 kB |
| Tags | CPython 3.12 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
f2395980366168b651d559e4d3f57596710e41c1678c94269ad4839667489523
|
|
BLAKE2b-256 checksum How to use checksums |
cefe9823e561cafd0f52503fcbda22f23e20302e3de6cdebaaafffc0e4940d86
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 224.0 kB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
7049d885ea64f23bc33d49adcb97284b88f555ca05ff17c28979f0654c6f8cff
|
|
BLAKE2b-256 checksum How to use checksums |
5d315bedeedf799c2b7aa893792648dfb09971a844c3ce6dafbe660d6748ea2b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_aarch64.whl
| Download URL | zooparallel-2026.2.2-cp311-cp311-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 217.7 kB |
| Tags | CPython 3.11 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
853f0f5d9ee36272b6d44935f11232a33a2a146b3a254b1f0801d51d3689226d
|
|
BLAKE2b-256 checksum How to use checksums |
f2ca4c1fd8f2000266babb711b2a58cac7435e9858ea1250173f1299e41fc2ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | zooparallel-2026.2.2-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 198.9 kB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
37ece87233c270c2d06bb7c1f18d0de5b1815f10972f0f8ce39fe8cf76c594ef
|
|
BLAKE2b-256 checksum How to use checksums |
9551309089b3b5c8ad9613e35caee98355043a99fc57cff7c82404c60f051c61
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp311-cp311-macosx_10_12_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp311-cp311-macosx_10_12_x86_64.whl |
|---|---|
| Size | 210.1 kB |
| Tags | CPython 3.11 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
bbb891f6201a654d897448d366ad8318c48a4a23e98c610d412d57acefbb25db
|
|
BLAKE2b-256 checksum How to use checksums |
7600accd4f742565dc620bf50afe013ebaebd9f0e18207f6d15f01c5aca32dd7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 224.2 kB |
| Tags | CPython 3.10 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
fd6fa8a6ae9a0f85910b21f0fb1ae666c89bfb281add5f16b8b4a4ee627bd488
|
|
BLAKE2b-256 checksum How to use checksums |
4c66fab60c4fb3a43cbc02c9c6ff76f99df6cc3024435fda17d460acbc9ef4c8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_aarch64.whl
| Download URL | zooparallel-2026.2.2-cp310-cp310-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 217.9 kB |
| Tags | CPython 3.10 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
752d17ccb0855818a4d94ed057dd0fcb6b16249056c2f1ec390d852d8978e67e
|
|
BLAKE2b-256 checksum How to use checksums |
e33011b14778bff761a2dca79b3ea282a5b5e5e1cce88a94381d9918116fec1a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | zooparallel-2026.2.2-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 199.3 kB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
599848735518441d253793bc24fa33f5a302b7fc32aa11da85d1bfa5be72c3ba
|
|
BLAKE2b-256 checksum How to use checksums |
1a4749a2432a8a2301cf98555d770c08fd8ce5f79ff375bd77ec7bb542dcc1b0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency logRelease files / zooparallel-2026.2.2-cp310-cp310-macosx_10_12_x86_64.whl
| Download URL | zooparallel-2026.2.2-cp310-cp310-macosx_10_12_x86_64.whl |
|---|---|
| Size | 210.4 kB |
| Tags | CPython 3.10 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
c836470ddda3f956b4a04434b62c2633a5e1ecf2a0e05b5d8459c9f247739052
|
|
BLAKE2b-256 checksum How to use checksums |
723f5c7073cba5aa0bd649cb0c01980e8d8fd74885685f9bcbbd42d723a15d4e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Feb 2, 2026.
Transparency log