Skip to main content

A implementation of asynchronous multiprocessing with progress logging.

Project description

parallel-transform

A implementation of asynchronous multiprocessing with progress logging.

Installation

pip install parallel-transform

Functions:

transform_list_parallel( list_to_transform, transform_func, *transform_args, verbose=True, processes=-1, min_log_frequency=1000, logger=None, log_func='info')

The elements in list_to_transform will be transformed based on the transform_func function, with the list element as the first arg, and *transform_args as the remaining args. If verbose is set to true, the progress every 5% or min_log_frequency processes will be logged, whichever is less. An optional logger can be passed; if no logger is passed, the logs will go to std out.

The order of the list_to_transform is maintained.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for parallel-transform, version 0.0.2
Filename, size File type Python version Upload date Hashes
Filename, size parallel_transform-0.0.2-py3-none-any.whl (2.7 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size parallel_transform-0.0.2.tar.gz (2.2 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page