Skip to main content

An asyncio API that mimics concurrent.futures, with support for task-graph executors

Project description


Parallels is a literary powered library. It provides an async API that mimics concurrent.futures, with support for task-graph executors.

These notebooks can be viewed using nbviewer until the documentation generator is complete.


In Python there are several standard APIs for interacting with executors. AsyncIO has the run_in_executor API, concurrent.futures has the Executor API, and other libraries like Dask and Ray have equivalent approaches. concurrent.futures is often available within other libraries, but its reduced features-set prevents the underlying library from implementing useful optimisations like Dask's deferred computation or task graph building.

Parallels implements a standard Executor interface which defines a synchronous submit method, and an asynchronous retrieve method. These methods operate upon value-less asyncio.Future handles which yield True upon task success, and raise an Exception otherwise. The Dask and Ray implementations accept these handles as arguments to future submit() calls, which can be used to build task graphs and avoid copying data to the local machine.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parallels-0.1.0.tar.gz (5.4 kB view hashes)

Uploaded Source

Built Distribution

parallels-0.1.0-py3-none-any.whl (6.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page