This is a VERY open question since this is my first time creating a cluster. I'm just wondering what type of security concerns will there be and how to prevent them.
Using SGE (currently installing and figuring out which schedule is the best) on an internal cluster.
Will allow PVM/MPI programs to run as well as Perl programs using one or the other or maybe just forking because they are embarrassingly parallel executions (if I remember correctly, SGE allows fork, but that was read a while ago before I compiled a lot more information. Someone please just comment on this).
There will be an external node that connects to the cluster and this node will submit the jobs received from the Internet/Server.
All users must submit their request to run a job through the internet to the server (trying to think of ways to not allow them to bypass this when they're locally connected).
Goals of this project:
Eventually allow people over the internet from anywhere submit jobs to run, and then be notified when the program is finished. Furthermore allow them to view the data, maybe even download the data for offline viewing.
Unlikely but possible: Maybe even allow users to upload programs to fine tune their data when our program is insufficient.