Skip to main content

A implementation of asynchronous multiprocessing with progress logging.

Project description

parallel-transform

A implementation of asynchronous multiprocessing with progress logging.

Installation

pip install parallel-transform

Functions:

transform_list_parallel( list_to_transform, transform_func, *transform_args, verbose=True, processes=-1, min_log_frequency=1000, logger=None, log_func='info')

The elements in list_to_transform will be transformed based on the transform_func function, with the list element as the first arg, and *transform_args as the remaining args. If verbose is set to true, the progress every 5% or min_log_frequency processes will be logged, whichever is less. An optional logger can be passed; if no logger is passed, the logs will go to std out.

The order of the list_to_transform is maintained.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for parallel-transform, version 0.0.3
Filename, size File type Python version Upload date Hashes
Filename, size parallel_transform-0.0.3.tar.gz (2.2 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page