Skip to main content

parallelazy

PyPi parallelazy

A lightweight Python plugin/worker framework with:

  • isolated plugin processes started with spawn;
  • topic-based publish/subscribe;
  • shared environment values and change notifications;
  • plugin-to-plugin RPC; and
  • PyTorch/CUDA-aware multiprocessing support.

Install

pip install parallelazy

for development

pip install -e .

Debug in VSCode

Due to a known issue with debugpy and spawn ( as opposite to fork ) processes, a small companion vscode extension has been developed in order to enable debugging.

https://marketplace.visualstudio.com/items?itemName=CesareMontresor.parallelazy-vscode

Quick start

import time

from parallelazy import Plugin, PluginManager


class Worker(Plugin):
    def on_start(self):
        self.env_set("worker.ready", True)

    def main(self):
        pass


def main():
    manager = PluginManager()
    descriptor = Worker.Descriptor(
        version="1.0.0",
        author="Application team",
        description="Example worker",
    )
    if not manager.load_plugin(descriptor):
        raise RuntimeError("Plugin failed to load")
    if not manager.start_plugin(descriptor.name):
        raise RuntimeError("Plugin failed to start")
    try:
        time.sleep(0.1)
        print(manager.env_get("worker.ready"))
    finally:
        manager.unload_plugin(descriptor.name)


if __name__ == "__main__":
    main()

Pipeline monitoring

Enable an optional read-only view of topic backlog, plugin process resources, and shared environment activity:

manager.enable_monitoring(sample_interval=1.0)
snapshot = manager.get_monitoring_snapshot()
manager.print_monitoring_report()
manager.disable_monitoring()

The monitor never reads or changes topic payloads. Topic backlog is reported as pending pipe bytes. Process metrics use psutil when installed, and NVIDIA GPU metrics use nvidia-ml-py; missing optional dependencies are identified with their install command.

Documentation

Read the documentation index for installation, concepts, API reference, usage patterns, and troubleshooting.

The complete runnable examples are in examples/. For example:

python -m examples.example_pubsub
python -m examples.example_rpc_calls

Metadata

Release files for parallelazy 0.1.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for parallelazy 0.1.2
File Size Uploaded Provenance Actions
parallelazy-0.1.2.tar.gz 55.3 kB With provenance Details for parallelazy-0.1.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for parallelazy 0.1.2
File Interpreter ABI Platform Actions
parallelazy-0.1.2-py3-none-any.whl Python 3 none any Details for parallelazy-0.1.2-py3-none-any.whl

Total release size: 107.9 kB

Release files / parallelazy-0.1.2.tar.gz

Download URL parallelazy-0.1.2.tar.gz
Size 55.3 kB
Tags Source
SHA-256 checksum
How to use checksums
a12b8b0f7ce85ce6c07065d14e92c26c5d47af149aac8f5df48862cb78b7e90d
BLAKE2b-256 checksum
How to use checksums
aca0dc27b5b153ba057a1494690554136905da88139956e4f60d800d4f77a122
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 18, 2026.

Transparency log

Release files / parallelazy-0.1.2-py3-none-any.whl

Download URL parallelazy-0.1.2-py3-none-any.whl
Size 52.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fb7b67643aa1eb23063ab469ce6cb17edacfedda6c8d55c0dc156a411f2c9378
BLAKE2b-256 checksum
How to use checksums
89c1705e9b98f1deb868929bf3129653f7261d7e3e6a8294ce35a4565c29c633
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 18, 2026.

Transparency log

Security for parallelazy 0.1.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for parallelazy-0.1.2.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 18, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page