Parallel processing tools for supercomputing with python.
Project description
Superpy distributes python programs across a cluster of machines or across multiple processors on a single machine. This is a coarse-grained form of parallelism in the sense that remote tasks generally run in separate processes and do not share memory with the caller.
Key features of superpy include:
Send tasks to remote servers or to same machine via XML RPC call
GUI to launch, monitor, and kill remote tasks
GUI can automatically launch tasks every day, hour, etc.
Works on the Microsoft Windows operating system
Can run as a windows service
Jobs submitted to windows can run as submitting user or as service user
Inputs/outputs are python objects via python pickle
Pure python implementation
Supports simple load-balancing to send tasks to best servers
What makes superpy different than the many other excellent parallel processing packages already available for python? The superpy package is designed to allow sending jobs across a large number of machines (both Windows and LINUX). This requires the ability to monitor, debug, and otherwise get information about the status of jobs.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.