Skip to main content
Join the official 2020 Python Developers SurveyStart the survey!

High-level python wapper for the Sun Grid Engine (SGE) using DRMAA and ZMQ

Project description

pythongrid overview

Main development site:

Contibutors: Chris Widmer, Cheng Soon Ong

This module provides high level functionality for cluster computing in python using the Sun Grid Engine. As some cluster environments are notoriously unreliable, pythongrid attempts to handle job monitoring and resubmission (in case of sudden death of nodes) under the hood, while providing the user with a simple map-reduce like interface.

Main features: - Uses ZMQ-based heart-beat to monitor job status - Robust error detection (out-of-memory, node failure) - Automated resubmission in case of unexpected failure - Error emails, including CPU/MEM statistics - Optional web-interface to monitor jobs - Let’s you easily switch between local multiprocessing and cluster computing

Dependencies - pyZMQ - drmaa-python

Get started (now on Pypi!): - easy_install pythongrid - adjust


  • 2013-07-08: fixed some issues with

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pythongrid, version 0.2
Filename, size File type Python version Upload date Hashes
Filename, size pythongrid-0.2.tar.gz (17.2 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page