Skip to main content

parallelazy

PyPi parallelazy

A lightweight Python plugin/worker framework with:

  • isolated plugin processes started with spawn;
  • topic-based publish/subscribe;
  • shared environment values and change notifications;
  • plugin-to-plugin RPC; and
  • PyTorch/CUDA-aware multiprocessing support.

Install

pip install parallelazy

for development

pip install -e .

Debug in VSCode

Due to a known issue with debugpy and spawn ( as opposite to fork ) processes, a small companion vscode extension has been developed in order to enable debugging.

https://marketplace.visualstudio.com/items?itemName=CesareMontresor.parallelazy-vscode

Quick start

import time

from parallelazy import Plugin, PluginManager


class Worker(Plugin):
    def on_start(self):
        self.env_set("worker.ready", True)

    def main(self):
        pass


def main():
    manager = PluginManager()
    descriptor = Worker.Descriptor(
        version="1.0.0",
        author="Application team",
        description="Example worker",
    )
    if not manager.load_plugin(descriptor):
        raise RuntimeError("Plugin failed to load")
    if not manager.start_plugin(descriptor.name):
        raise RuntimeError("Plugin failed to start")
    try:
        time.sleep(0.1)
        print(manager.env_get("worker.ready"))
    finally:
        manager.unload_plugin(descriptor.name)


if __name__ == "__main__":
    main()

Pipeline monitoring

Enable an optional read-only view of topic backlog, plugin process resources, and shared environment activity:

manager.enable_monitoring(sample_interval=1.0)
snapshot = manager.get_monitoring_snapshot()
manager.print_monitoring_report()
manager.disable_monitoring()

The monitor never reads or changes topic payloads. Topic backlog is reported as pending pipe bytes. Process metrics use psutil when installed, and NVIDIA GPU metrics use nvidia-ml-py; missing optional dependencies are identified with their install command.

Documentation

Read the documentation index for installation, concepts, API reference, usage patterns, and troubleshooting.

The complete runnable examples are in examples/. For example:

python -m examples.example_pubsub
python -m examples.example_rpc_calls

Metadata

Release files for parallelazy 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for parallelazy 0.1.3
File Size Uploaded Provenance Actions
parallelazy-0.1.3.tar.gz 58.5 kB With provenance Details for parallelazy-0.1.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for parallelazy 0.1.3
File Interpreter ABI Platform Actions
parallelazy-0.1.3-py3-none-any.whl Python 3 none any Details for parallelazy-0.1.3-py3-none-any.whl

Total release size: 113.0 kB

Release files / parallelazy-0.1.3.tar.gz

Download URL parallelazy-0.1.3.tar.gz
Size 58.5 kB
Tags Source
SHA-256 checksum
How to use checksums
2fbd3d6b392b32a316e612886a7e03a769681060141df0384d308eb1615dd9f5
BLAKE2b-256 checksum
How to use checksums
3a1eb73a99d877c1829264b5689628e1331ef1777b202f5fedeb38f0958bdcc8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 19, 2026.

Transparency log

Release files / parallelazy-0.1.3-py3-none-any.whl

Download URL parallelazy-0.1.3-py3-none-any.whl
Size 54.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d56cc4ffd53bad2655df768524bed436cce5cefabe4e3eaf758091b9870dfccd
BLAKE2b-256 checksum
How to use checksums
6217dec46b5b800a2ea3c4087b8547e2c13d79c076c79e0ad9fcc67424f779d1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 19, 2026.

Transparency log

Security for parallelazy 0.1.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for parallelazy-0.1.3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 19, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page