Parallel Job Manager
This package is part of the signal-processing and machine learning toolbox Bob. It provides a set of python wrappers around SGE utilities like qsub, qstat and qdel. It interacts with these tools to submit and manage grid jobs making up a complete workflow ecosystem. Currently, it is set up to work with the SGE grid at Idiap, but it is also possible to modify it to be used in other SGE grids.
Since version 1.0.x there is also a local submission system introduced. Instead of sending jobs to the SGE grid, it executes them in parallel processes on the local machine, using a simple scheduling system.
Complete Bob’s installation instructions. Then, to install this pacakge, run:
$ conda install gridtk
For questions or reporting issues to this software package, contact our development mailing list.