A implementation of asynchronous multiprocessing with progress logging.
Project description
parallel-transform
A implementation of asynchronous multiprocessing with progress logging.
Installation
pip install parallel-transform
Functions:
transform_list_parallel( list_to_transform, transform_func, *transform_args, verbose=True, processes=-1, min_log_frequency=1000, logger=None, log_func='info')
The elements in list_to_transform
will be transformed based on the transform_func
function, with the list element as the first arg, and *transform_args
as the remaining args. If verbose is set to true, the progress every 5% or min_log_frequency
processes will be logged, whichever is less. An optional logger can be passed; if no logger is passed, the logs will go to std out.
The order of the list_to_transform is maintained.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for parallel_transform-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c3e82c9a2d2c5d09ff78314e1098c799315a6726e3bec6f9dea3794a53a3c9de |
|
MD5 | 075098b920ee06eb07ad36b728870840 |
|
BLAKE2b-256 | 6f36e79aab593744cf5eb971ed0557c25aacd79b1c865f65608129d7372cfde9 |