Using the master-slave mode, this utility dispatches parallel jobs to a group of clusters. It runs on the master node (e.g. your
desktop), and executes commands remotely on slave nodes through SSH, therefore, no extra software needs to be installed remotely. When the program is running, it opens an
light-weight http server to enable the control of job dispatching (i.e. add jobs, enable/disable cluster nodes, monitor the job progress, log error messages). It
is particularly suitable for running a large number of computationally expensive jobs in parallel on remote clusters.
This code is written in Python, and has been tested on Linux, Windows 7 and Mac OSX.
Download
Required Packages:
- CherryPy (v3.0+) to provide light-weight http server
- Cheetah (v2.01+) for web page generation
- paramiko (v1.76+) to provide SSH command execution
- matplotlib (v0.99+) for chart generation