Memory-managed parallel computing for medium-sized computational tasks.
Project description
SmartMultiprocessing
A drop-in replacement for Python's multiprocessing
library with many extra features, including: memory management, smart task scheduling, a pause button, a GUI, and more.
SmartMultiprocessing
is ideal for use cases beyond typical multiprocessing
use, like:
- Running code where memory usage is different depending on input values
- Benchmarking experimental code where memory usage is not well understood
- Running code on a machine where it's important to be able to pause execution/change thread and memory use on the fly
- Being able to monitor the performance of code without having to write your own monitoring library from scratch
SmartMultiprocessing is in active development!
This project is a spin-out from code that @emilyhunt wrote during her PhD. It's currently in alpha / active development - check back here soon for the first production-ready versions!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
smartmultiprocessing-0.0.1.tar.gz
(18.3 kB
view hashes)
Built Distribution
Close
Hashes for smartmultiprocessing-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b1313e815557f9b8b778a9ecebb7f590c0c511f6c6e9fab349186a89f3336ff0 |
|
MD5 | 86b1a5488d8b9a40fd0cc9ef6bc4ad54 |
|
BLAKE2b-256 | fc4bbb83bfa24e60e3440b4fc5e5fc3c6ca7b7f553ed44e00dc9553e8d4e11ef |
Close
Hashes for smartmultiprocessing-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc0bc9279d8c6329292fbfe8714b0c1ea2c280340f9c8b461b98bbd3a21fa252 |
|
MD5 | 416f8a16b8fca2d8ccafef51a052ff69 |
|
BLAKE2b-256 | 891f5cd36319e4e7e31b54c050c399331fd918aaf1429d5e40fb594c2aef7a33 |