Skip to main content

Async Process Pool and Queue

Project description

Async Process Pool and Queue

This contains an asyncio aware multiprocessing utility that allows work to be scheduled across multiple processes.

It consists of the following sub-utilities:

  • Async Process Queue: allows awaitable cross-process queues
  • Process Pool: allows for a pool of processes to be created which can take work. Communication to these processes is via an async process queue.
  • Watchdog: a asyncio implementation of a watchdog timer. It will fire an action if it is not reset within a set time. For example: re-registering a worker if a heartbeat signal is not received at least every 5 seconds.

Requirements

This library requires Python 3.7 or greater to be able to run. The library package installer will block attempts to use Python 3.6 or lower.

The library is tested on Python 3.7, taking advantage of significant improvements to the asyncio API and implementation in Python. It is tested most heavily on Debian/Ubuntu Linux, but known to work on Microsoft Windows.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

async_process_pool-0.0.2.tar.gz (7.6 kB view details)

Uploaded Source

File details

Details for the file async_process_pool-0.0.2.tar.gz.

File metadata

  • Download URL: async_process_pool-0.0.2.tar.gz
  • Upload date:
  • Size: 7.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

File hashes

Hashes for async_process_pool-0.0.2.tar.gz
Algorithm Hash digest
SHA256 523a877f8ea1c6832692d6760caa671b2fc2cd4199159bab3e35dac73ae7d4df
MD5 479506386a4c712692383338d931b11d
BLAKE2b-256 d0c33eaf1c85e5d24493917aad916b9285845869215d7dad1bbd8b4bf02321d6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page