Skip to main content

Parallel Process Queue (ppqueue) for Python

Project description

ppqueue

Parallel Process Queue (ppqueue) for Python

Formerly known as ezpq

Links
Code Repo https://www.github.com/fresh2dev/ppqueue
Mirror Repo https://www.Fresh2.dev/code/r/ppqueue
Documentation https://www.Fresh2.dev/code/r/ppqueue/i
Changelog https://www.Fresh2.dev/code/r/ppqueue/i/changelog
License https://www.Fresh2.dev/code/r/ppqueue/i/license
Funding https://www.Fresh2.dev/funding

GitHub release (latest SemVer) GitHub Release Date License GitHub issues GitHub pull requests GitHub Repo stars PyPI - Downloads Docs Website Coverage Website Funding

Overview

ppqueue is a Python module that serves as an abstraction layer to both multiprocessing.Process and threading.Thread. I built ppqueue because I too often notice that parallelizing code results in ugly code. With this simple Queue, you can parallelize code easily and attractively. ppqueue offers:

  • a single API for parallel execution using processes or threads.
  • FIFO priority queueing.
  • Gantt charts of job execution (thanks plotnine + pandas)
  • progress bars (thanks to tqdm)

Install

Install from PyPi:

pip install ppqueue[plot]

Examples

An notebook of examples is available at:

https://www.f2dv.com/code/r/ppqueue/i/page/examples/

And more examples are provided in the reference docs:

https://www.f2dv.com/code/r/ppqueue/i/reference/


Brought to you by...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ppqueue-0.3.0.tar.gz (35.6 kB view hashes)

Uploaded Source

Built Distribution

ppqueue-0.3.0-py3-none-any.whl (36.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page