Skip to main content

A high level pipeline pattern implemented in Python with ZeroMQ.

Pipeline is a data and task distribution pattern for distributed and parallel computing. This implementation abstracts away many details of ZeroMQ while keeping all the performance advantages the framework offers.

This library focuses more on task distribution than data distribution, since distributing data creates a memory bottleneck and tends not to scale well.

Client workers are responsible for both retrieval and processing of data in this implementation.

Github repository: https://github.com/ailling/py-zmq-pipeline

Metadata

Release files for py-zmq-pipeline 0.1.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for py-zmq-pipeline 0.1.7
File Size Uploaded Provenance Actions
py-zmq-pipeline-0.1.7.tar.gz 10.9 kB Without provenance Details for py-zmq-pipeline-0.1.7.tar.gz

Release files / py-zmq-pipeline-0.1.7.tar.gz

Download URL py-zmq-pipeline-0.1.7.tar.gz
Size 10.9 kB
Tags Source
SHA-256 checksum
How to use checksums
60060a460b8ad706225959af687bb771f55f52837bedca6cff4659b4ac4c8899
BLAKE2b-256 checksum
How to use checksums
6bdb1229cfb3461e47517cca3af2b4e508c74ebf6bcdad0cfad9d0a106f047e5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for py-zmq-pipeline 0.1.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page