PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of progress bars.
Project description
Parallel TQDM
PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of progress bars.
Free software: MIT license
Documentation: https://pqdm.readthedocs.io.
Install & Use
To install
pip install pqdm
and use
from pqdm.processes import pqdm # If you want threads instead: # from pqdm.threads import pqdm args_1 = [1, 2, 3] args_2 = [2, 3, 4] def multiply(a,b): return a*b pqdm(zip(args_1, args_2), argument_type='args', n_jobs=2)
Features
parellize your tqdm runs using processes or threads thanks to concurrent.futures,
just import pqdm from `pqdm.threads` or `pqdm.processes` to start,
automatic usage of `tqdm.notebook` when iPython/Jupyter notebook environment detected,
automatic parsing of `pqdm` kwargs and separating between `concurrent.Executor` args and `tqdm` args,
support for any iterable and passing items as kwargs, args or directly to function which is being applied
support bounded exectutors via https://github.com/mowshon/bounded_pool_executor
Credits
Written by Piotr Szymański <niedakh@gmail.com>.
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.0.1 (2020-03-05)
First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.