Skip to main content

Parallel Computing Tools

Project description

This description is under construction.

Parallel Computing Tools (This is a tool to achieve clear and safe management of memory and other resources by separating parallel computations in units of files.)

並列計算ツール (ファイルの単位で並列計算を実施することで、メモリ等の管理を明快かつ安全に実現するツールです。)

  • pythonの並列処理はメモリ管理がよくわからん (不安な気持ちになる)
  • そこで、いっそのことファイルごと別プロセスで立ち上げるような並列処理を考えた

マスター側

from mult import master

input_ls = [i for i in range(10)]
output_ls = master.call(
	"path_to_slave/slave.py",	# スレーブファイル名
	input_ls,	# 入力のリスト (ジョブごと)
	n = 4,	# 並列数
	job_order = "ordered",	# ジョブ実行順序 (random, ordered)
	progress = True	# 進捗表示
)
print(output_ls)	# 結果の確認

スレーブ側 (slave.py)

import time, random
from mult import slave

# 実行したい処理
def heavy_process(num):
	time.sleep(random.random()*3)
	return 2**num

num = slave.get_input()
result = heavy_process(num)
slave.send_output(result)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mult-1.1.1.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

mult-1.1.1-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file mult-1.1.1.tar.gz.

File metadata

  • Download URL: mult-1.1.1.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.8

File hashes

Hashes for mult-1.1.1.tar.gz
Algorithm Hash digest
SHA256 e932515d88994e9e2cdbb8e78c6d466b3d4c7805951e7f77ef3c8057c5676044
MD5 7de3e18ff1eb0a978e46d01d59c2eb5f
BLAKE2b-256 d0d70b93ba3fb0252d96b7af3548e879ed7c9f2af7b0bbbe6fd5371d7ecaa44b

See more details on using hashes here.

File details

Details for the file mult-1.1.1-py3-none-any.whl.

File metadata

  • Download URL: mult-1.1.1-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.8

File hashes

Hashes for mult-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 439d20c490d24115f019862dde05e6c2ca3079855e5840a773d8c3a226a0bbc8
MD5 6145f4363e204b93625b152e9ab9c829
BLAKE2b-256 fdbf269c2164192e3c6803f85571cc9ebf614a00b3808fa1af363ade1a023e97

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page