Easy Python multiprocessing
Project description
easy_multip
easy_multip is a small tool designed to quickly allow Python multiprocessing capabilities while greatly simplifying code for easier use.
Current Features
- easy_multip.map(func, arg_group, leave_one_cpu_free=True)
- map() or list comprehension type functionality that is parallelized using multiprocessing and includes a progress bar
- Usage is similar to the below constructs:
list(map(func, arg_group)) or [func(arg) for arg in arg_group]
- easy_multip.doloop(func, arg_group, leave_one_cpu_free=True)
- for loop equivalent that runs a function that returns None
- Useful in situations like file processing where each operation is expensive and totally independent
- Allocates jobs evenly among processors and provides a progress bar... of sorts
- Usage is similar to the below construct:
for arg in arg_group: func(arg)
- easy_multip.decorators.use_multip(func, leave_one_cpu_free=True)
- Decorator providing capability of quickly adding multiprocessing to a function operating on a list
- ONLY for functions taking a list first arg that returns a list or None
- DO NOT USE
@decorator
syntax! Must use the following pattern:def _func(list_arg, *args, **kwargs): # stuff happens return [] (or None) func = use_multip(_func)
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
easy_multip-0.3.0.tar.gz
(4.9 kB
view hashes)
Built Distribution
Close
Hashes for easy_multip-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9578eac3df28c7c938149445c84386cea2f2ae43b9297c6ddc300f592d3698ba |
|
MD5 | ce281ed02ba16e403c28495fcfd3df2f |
|
BLAKE2b-256 | 9df0fe0f6f3dd022b5f361de8329626e0c61e444869eec60cb47f93b551f6f67 |