Package to simplify process of parallelising tasks
Project description
parallelize
parallelize
is a Python package to simplify the process of parallelising your taks in Python. It takes advantage of the multiprocessing
module to spawn new processes for your job.
Requirements
- Python 3.X
Installation
To install parallelize
, you can either install from the source code or using pip
.
To install from source code, first clone the repository. Then, run python setup.py install
in the root directory.
Documentation
To build the documentation, run make html
inside the docs/
folder. The documention will be found in the docs/build/html
directory. Alternatively, view documentation here.
Usage
To parallelise a task in Python, you should wrap the entire code inside a function and have the first argument of your function receive the iterable your function will be operating over.
>>> from parallelize import parallelize
>>> def foo(iterable: list) -> int:
... output = 0
... for i in iterable:
... output = i**4
... return output
>>> numbers = list(range(50000000))
>>> %time foo(numbers)
Wall time: 21.5 s
>>> parallelize.parallel(foo, numbers, 6)
Completed 'parallel' in 6.2743 secs
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pyparallelize-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2d5502f587a9b1d3bbd629626a5db0312189a835c0667c5345c003dfdbd6ae70 |
|
MD5 | 7941f79e8dc072eb231bcb40d4b53fa5 |
|
BLAKE2b-256 | cdb51fb39428fade37089774b96dd4cd03d23bdeefdae460f9b29a88ce095014 |