Parallel Computing Tools
Project description
This description is under construction.
Parallel Computing Tools (This is a tool to achieve clear and safe management of memory and other resources by separating parallel computations in units of files.)
並列計算ツール (ファイルの単位で並列計算を実施することで、メモリ等の管理を明快かつ安全に実現するツールです。)
- pythonの並列処理はメモリ管理がよくわからん (不安な気持ちになる)
- そこで、いっそのことファイルごと別プロセスで立ち上げるような並列処理を考えた
マスター側
from mult import master
input_ls = [i for i in range(10)]
output_ls = master.call(
"path_to_slave/slave.py", # スレーブファイル名
input_ls, # 入力のリスト (ジョブごと)
n = 4, # 並列数
job_order = "ordered", # ジョブ実行順序 (random, ordered)
progress = True # 進捗表示
)
print(output_ls) # 結果の確認
スレーブ側 (slave.py)
import time, random
from mult import slave
# 実行したい処理
def heavy_process(num):
time.sleep(random.random()*3)
return 2**num
num = slave.get_input()
result = heavy_process(num)
slave.send_output(result)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mult-1.1.1.tar.gz
(5.4 kB
view details)
Built Distribution
mult-1.1.1-py3-none-any.whl
(8.2 kB
view details)
File details
Details for the file mult-1.1.1.tar.gz
.
File metadata
- Download URL: mult-1.1.1.tar.gz
- Upload date:
- Size: 5.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e932515d88994e9e2cdbb8e78c6d466b3d4c7805951e7f77ef3c8057c5676044 |
|
MD5 | 7de3e18ff1eb0a978e46d01d59c2eb5f |
|
BLAKE2b-256 | d0d70b93ba3fb0252d96b7af3548e879ed7c9f2af7b0bbbe6fd5371d7ecaa44b |
File details
Details for the file mult-1.1.1-py3-none-any.whl
.
File metadata
- Download URL: mult-1.1.1-py3-none-any.whl
- Upload date:
- Size: 8.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 439d20c490d24115f019862dde05e6c2ca3079855e5840a773d8c3a226a0bbc8 |
|
MD5 | 6145f4363e204b93625b152e9ab9c829 |
|
BLAKE2b-256 | fdbf269c2164192e3c6803f85571cc9ebf614a00b3808fa1af363ade1a023e97 |