Skip to main content

collective.futures

https://secure.travis-ci.org/datakurre/collective.futures.png

This is a collective package for providing yet another way to do asynchronous (non-blocking) processing on Plone.

This time we speak in terms of promises and futures: promises are asynchronously run functions, which provide their results as requested futures for add-on your code.

A major differences for any other alternatives is that this does not require any additional services, but requires only Plone running on top of a Zope instance.

A major limitation is that the asynchronously executed code cannot access the database in any way (or you may face unexpected consequences). Also, this brings no benefits with HAProxy and fixed amount current requests per instance.

Example

from Products.Five.browser import BrowserView

from collective import futures


def my_async_task(*args):
    # a lot of time consuming async processing
    return u'my asynchronously computed value'


class MyView(BrowserView):

    def __call__(self, *args):
        try:
            return futures.result('my_unique_key')
        except futures.FutureNotSubmittedError:
            futures.submit('my_unique_key', my_async_task, *args)
            return u'just a placeholder value'

or

from Products.Five.browser import BrowserView

from collective import futures


def my_async_task(*args):
    # a lot of time consuming async processing
    return u'my asynchronously computed value'


class MyView(BrowserView):

    def __call__(self, *args):
        return futures.resultOrSubmit(
            'my_unique_key', u'placeholder value', my_async_task, *args)

Explanation

This package uses approach, which kind of splits a single request into two separate passes:

Whenever some add-on code requires a value to be computed asynchronously, it tries to request for a named future result at first and only then submits a promise function to compute result for that future.

If any futures are submitted, the initial response is never published, but instead the current transaction is aborted and the submitted promise functions are executed in parallel threads separate from the default Zope threads (or even in parallel processes) and their return values are collected (see also the documentation of concurrent.futures in Python).

When all promise functions have been resolved, the original request is cloned, resolved values are set as futures and a new internal request is dispatched.

After this second pass, the add-on code can use the now available futures, not submit more futures, and finally, the response is published all the way to the browser.


For more background information: http://datakurre.pandala.org/2014/05/asynchronous-stream-iterators-and.html

Changelog

0.9.3 (2018-09-05)

  • Fix issue where plone.protect tried to parse PromiseWorkerStreamIterator as xml [datakurre]

0.9.2 (2018-06-29)

  • Add to log exceptions within futures to get full exception stacktraces [datakurre]

0.9.1 (2016-05-25)

  • Fix issue where resolved futures were not passed for nested requests [datakurre]

0.9.0 (2014-10-23)

  • First release.

Metadata

Release files for collective.futures 0.9.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for collective.futures 0.9.3
File Size Uploaded
collective.futures-0.9.3.tar.gz 9.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for collective.futures 0.9.3
File Interpreter ABI Platform
collective.futures-0.9.3-py2-none-any.whl Python 2 none any Details

Total release size: 24.7 kB

Release files / collective.futures-0.9.3.tar.gz

Download URL collective.futures-0.9.3.tar.gz
Size 9.0 kB
Tags Source
SHA-256 checksum
How to use checksums
d81bcf5048692352c31aaa62f2e08d69d6fd7b6592a6efa6a53831fff7ac5eb0
BLAKE2b-256 checksum
How to use checksums
1489f571196e044378a563b95c2126b27dc66b8155d17fadb8aad1383b94d95b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/38.4.0 requests-toolbelt/0.8.0 tqdm/4.21.0 CPython/2.7.15

Release files / collective.futures-0.9.3-py2-none-any.whl

Download URL collective.futures-0.9.3-py2-none-any.whl
Size 15.7 kB
Tags Python 2
SHA-256 checksum
How to use checksums
62af75ba41b6e92cd7e603058fbb02ab15d07de7cf5812882976cf80e9afa22c
BLAKE2b-256 checksum
How to use checksums
97bc8a9fd18c7e4f4ec3a34f7012e5635f6063dfadf08d0fb7c3c8220daf3f39
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/38.4.0 requests-toolbelt/0.8.0 tqdm/4.21.0 CPython/2.7.15

Release history Release notifications | RSS feed

This release

0.9.3 This release

2 release files

0.9.2

2 release files

0.9.1

1 release file

0.9.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page