Skip to main content

Run a coroutine with each item in an iterable, concurrently

Project description

aioconcurrency Build Status

Run a coroutine with each item in an iterable, concurrently

Install

pip install aioconcurrency

Usage example

import aioconcurrency

items = [1, 2, 3, 4]
async def f(item):
    return item * 2

async def main():
    await aioconcurrency.map(items, f, concurrency=2)  # Returns [2, 4, 6, 8]

    async for result in aioconcurrency.each(items, f, concurrency=2):
        print(result)  # Prints 2 4 6 8 in random order

Api

aioconcurrency.map

Runs the given coroutine concurrently with each item in an iterable. The list of the return values will be ordered as if ran serially.

items

An iterable object.

coro

Coroutine to feed each item to.

optional: concurrency

Number of concurrent runs of coro. Defaults to aioconcurrency.Infinite.

optional: executor

Can be an instance of ThreadPoolExecutor.

optional: loop

The asyncio event loop that will be used.

aioconcurrency.each

Runs the given coroutine concurrently with each item in an iterable. Returns a generator that may be used to iterate over the return values. The generator yields values as soon as they are available.

items

An iterable object. If an asyncio.Queue is passed then .each will read from it indefinitely.

coro

Coroutine to feed each item to.

optional: concurrency

Number of concurrent runs of coro. Defaults to aioconcurrency.Infinite.

optional: executor

Can be an instance of ThreadPoolExecutor.

optional: loop

The asyncio event loop that will be used.

optional: discard_results

If truthy, discard the return value of coro. Defaults to false.

property: wait()

Coroutine. May be used to wait until all items have been processed.

property: processed_count

The number of items that have been processed so far.

property: cancel()

Cancels all runs of coro.

Tests

pytest .

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aioconcurrency-0.5.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

aioconcurrency-0.5.0-py3.7.egg (7.0 kB view details)

Uploaded Egg

File details

Details for the file aioconcurrency-0.5.0.tar.gz.

File metadata

  • Download URL: aioconcurrency-0.5.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.29.1 CPython/3.7.5

File hashes

Hashes for aioconcurrency-0.5.0.tar.gz
Algorithm Hash digest
SHA256 fcc18102d6ec3c25a3fd6b3b361e257ffb9f71a9931a097bfc374d269dc6fd57
MD5 2f916934a44d23c4542f0c891a2a7c3d
BLAKE2b-256 75ed0a57be8ee3afcef3da04b7374f9522bdb31ddeac4d2c74c604962c01e50f

See more details on using hashes here.

File details

Details for the file aioconcurrency-0.5.0-py3.7.egg.

File metadata

  • Download URL: aioconcurrency-0.5.0-py3.7.egg
  • Upload date:
  • Size: 7.0 kB
  • Tags: Egg
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.29.1 CPython/3.7.5

File hashes

Hashes for aioconcurrency-0.5.0-py3.7.egg
Algorithm Hash digest
SHA256 4516c7a05baddcd73047365927f3e25c24404ea1db760b1788ef9c198be8e467
MD5 a9fc0901cb61a240feeeefda32443046
BLAKE2b-256 f0436867ce1d07c2cc4bb3c72f237ee647ba3b195a60d39030027eeaa0071ab2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page