Async tools for Python
Project description
Async Tools for Python.
Threading
Threading is the most simple thing, but because of GIL it’s useless for computation. Only use when you want to parallelize the access to a blocking resource, e.g. network.
Parallel
Source: asynctools/threading/Parallel.py
Execute functions in parallel and collect results. Each function is executed in its own thread, all threads exit immediately.
Methods:
join(): Wait for all tasks to be finished, and return two lists:
A list of results
A list of exceptions
Example:
from asynctools.threading import Parallel
def request(url):
# ... do request
return data
# Execute
pll = Parallel(request)
for url in links:
pll.job(url) # Starts a new thread
# Wait for the results
results, errors = pll.join()
Pool
Source: asynctools/threading/Pool.py
Create a pool of threads and execute work in it. Useful if you do want to launch a limited number of long-living threads.
Methods:
join(): Wait for all tasks to be finished and return (results, errors) (same as with `Pool <#pool>`__)
close(): Terminate all threads.
__enter__, __exit__ context manager to be used with with statement
Example:
from asynctools.threading import Pool
def request(url):
# ... do long request
return data
# Make pool
pool = Pool(request, 5)
# Assign some job
for url in links:
pll.job(url) # Runs in a pool
# Wait for the results
results, errors = pll.join()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for asynctools-0.0.1-0.linux-x86_64.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 435206a041a6eacadf1df5f2ca802b185af91812566716991551eae34a3fd9c7 |
|
MD5 | 20324c7003fc1152c6b1ba864a8f3ec8 |
|
BLAKE2b-256 | 529229b2cd71f2d8ef54ccd76b09e33479fdc29218bbe7b26de3a7eda09c3850 |