a facility for distributed computing
Project description
jobmanager
Easy distributed computing based on the python class SyncManager for remote communication and python module multiprocessing for local parallelism.
Documentation
The documentation is available at http://cimatosa.github.io/jobmanager/
TODO
- timeout for client
- single proxy for client and queue for subprocesses
- user signal to server to retrieve status
known Problems
Python2.7
- regular shutdown takes very long -> travis tests cancel due to timeout
Python3.4
- some tests result in
segmentation fault (core dumped), nonetheless they pass
Therefore, it is highly encouraged to use Python3.5 (and probably higher).
Developer's note (out of date)
After cloning into jobmanager, create a virtual environment
virtualenv --system-site-packages ve_jm
source ve_jm/bin/activate
Install all dependencies
python setup.py develop
Running an example
python examples/simple_example.py
Running tests
python setup.py test
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
jobmanager-0.4.0.tar.gz
(31.8 kB
view details)
Built Distribution
File details
Details for the file jobmanager-0.4.0.tar.gz.
File metadata
- Download URL: jobmanager-0.4.0.tar.gz
- Upload date:
- Size: 31.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.11.3 Linux/5.10.0-23-amd64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 490f4dd3d6de081021b003a643556f1a7e46fb3efa1ff0d31c612b9d5b230a60 |
|
| MD5 | 46187edf430509104d59a8f168f9b618 |
|
| BLAKE2b-256 | 26d6ccb02d17098403bdde1105a150950f861dab06e4d28c03501ea57f2a1d85 |
File details
Details for the file jobmanager-0.4.0-py3-none-any.whl.
File metadata
- Download URL: jobmanager-0.4.0-py3-none-any.whl
- Upload date:
- Size: 33.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.11.3 Linux/5.10.0-23-amd64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b310c2dd788e7e5e807539aa1f73d2c511236cfcfeccb2571b3a2a2076a0268c |
|
| MD5 | deb0032fcb2207d7b366e2fb25a1161a |
|
| BLAKE2b-256 | f15ae33a2f0d1259a91c6a07e457fc792f7b0c94608b5216ba493ec7ea88848f |
