Skip to main content

PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of progress bars.

Project description

Parallel TQDM

https://img.shields.io/pypi/v/pqdm.svg https://img.shields.io/travis/niedakh/pqdm.svg Documentation Status Updates

PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of progress bars.

Install & Use

To install

pip install pqdm

and use

from pqdm.processes import pqdm
# If you want threads instead:
# from pqdm.threads import pqdm

args_1 = [1, 2, 3]
args_2 = [2, 3, 4]

def multiply(a,b):
    return a*b

pqdm(zip(args_1, args_2), argument_type='args', n_jobs=2)

Features

  • parellize your tqdm runs using processes or threads thanks to concurrent.futures,

  • just import pqdm from `pqdm.threads` or `pqdm.processes` to start,

  • automatic usage of `tqdm.notebook` when iPython/Jupyter notebook environment detected,

  • automatic parsing of `pqdm` kwargs and separating between `concurrent.Executor` args and `tqdm` args,

  • support for any iterable and passing items as kwargs, args or directly to function which is being applied

  • support bounded exectutors via https://github.com/mowshon/bounded_pool_executor

Credits

Written by Piotr Szymański <niedakh@gmail.com>.

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.0.1 (2020-03-05)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pqdm-0.0.1.tar.gz (10.8 kB view hashes)

Uploaded Source

Built Distribution

pqdm-0.0.1-py2.py3-none-any.whl (6.1 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page