We are looking to deploy a queueing system, and SGE is looking like it will meet nearly all of our wishes. However, we had the idea of supporting both a synchronous and asynchronous queueing model. In other words:
We would have all our worker nodes tied to a synchronous queue, so that jobs that get assigned to them would queue up as normal - i.e. a job runs, when it finishes another is accepted and run.
We wanted to be able to assign "asynchronous" jobs to nodes as well. These would be tasks that could be done in parallel with other jobs, usually maintenance tasks on the machines themselves.
I see in the SGE documentation that it is possible to define multiple queues across nodes, but that isn't quite the same thing as having a queue that takes any job given to it and launches it into the background, then accepts another. I'm not completely up to speed on all the configuration options in SGE, but it seems like this might be possible. Can anyone point me towards some info on how this might be configured?