Questions tagged [gridengine]
Grid Engine is a distributed resource management (DRM) system that manages the distribution of users' workloads to available compute resources.
18
questions with no upvoted or accepted answers
2
votes
0
answers
206
views
Programmatically add EC2 execute nodes to Grid Engine cluster
I am running Grid Scheduler (fka Sun Grid Engine) on Amazon Web Services. Master node is running all the time, but I want to programmatically add nodes to the cluster (also remove - but remove is not ...
2
votes
1
answer
596
views
Prevent users running processes on cluster head node
What ways are there to prevent users from starting long running, resource intensive processes on the headnode of a Rocks cluster?
I've tried:
asking politely
setting the nice level in limits.conf ...
2
votes
0
answers
2k
views
Sun Grid Engine (SGE) / limiting simultaneous array job sub-tasks
I am installing a Sun Grid Engine environment and I have a scheduler limit that I can't quite figure out how to implement.
My users will create array jobs that have hundreds of sub-tasks. I would ...
1
vote
0
answers
23
views
How to limit the master host using 1 slot for each job on gridengine?
I run the gridengine on my cluster and like to have a master queue where each job can only have 1 slot on the master host. but i do not find the way to configure this.
I learned that resource limits ...
1
vote
0
answers
61
views
View/request instruction sets available on SGE host
How can I view or request hosts that can handle a particular instruction set in SGE?
With Slurm, to view available instruction sets on each host I can use
sinfo --Node -o '%n %f',
and to submit a ...
1
vote
1
answer
1k
views
Trying to get qsub to work on my cluster
Trying to get qsub to work on my cluster (single node right now but more are coming) So far trying to submit with qsub was returning
error: commlib error: got select error (Connection refused)
...
1
vote
0
answers
125
views
SGE qsub concatenate different requests for different hosts
I wonder it is possible to concatenate multiple requests for different hosts in SGE qsub command? For example, I tried this:
qsub -l h="compute-0-[0-9]" -pe smp 6 -l h="compute-0-2[0-9]" -pe smp 4
...
1
vote
1
answer
2k
views
Setting enviromental variables for login shells under root account in FreeBSD
I am currently in the process of configuring Open Grid Scheduler in FreeBSD. As part of this process I need to set the environmental variableSGE_ROOTas root.
To do this I have been experimenting with ...
1
vote
0
answers
87
views
systemimager and sun grid engine queuing system
I'm about to install our new cluster. I've installed the first node and used it for golden-image. As a queuing software we use SGE (Sun Grid Engine).
After installing of the first node I tested ...
1
vote
1
answer
229
views
OpenMPI in SGE fails when not observed
I know the topic is weird but so is my problem. On our cluster we have SGE with OpenMPI compiled for tight integration. When I set it up it worked just fine in my tests and so far there have been no ...
1
vote
1
answer
482
views
How to limit jobs in an indicated queue in SGE
I have two queues in SGE for different purposes. Each of them has a limit in slots. What I want is to have only a certain number of jobs submitted to a queue waiting even when the other queue is idle. ...
0
votes
1
answer
139
views
How to create a SGE queue which can only be assigned jobs manually?
I have 5 nodes in an SGE cluster. I'd like to make it so one of those nodes can only be used by a specific queue, "test.q".
I can remove that node from hostlist on all of my other queues, and set ...
0
votes
1
answer
98
views
How to allow concurrent execution of job arrays with job share (-js)
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based ...
0
votes
1
answer
63
views
How to make grid master "accept" gone hosts?
With gridengine-master 6.2u5-7.3 (Ubuntu Trusty), our /var/lib/gridengine/spool/qmaster/messages gets constantly filled with:
12/07/2016 04:11:43|worker|tools-grid-master|E|got load report of unknown ...
0
votes
1
answer
182
views
Sun Grid Engine Dynamic resource allocation
My cluster is running Sun's Grid Engine version "GE 6.2u5 $Date: 2009/12/01 12:24:06 $". I'd like to submit a single job to the queue which is defined by a bash script containing a number of commands. ...
0
votes
1
answer
116
views
Sun Grid Engine : jobs are not well balanced
I use Open Grid Scheduler (a fork/copy of Sun Grid Engine).
I have tried this configuration from master:
# qconf -mattr exechost complex_values slots=8 slave2
# qconf -mq all.q | grep slots
slots ...
0
votes
1
answer
125
views
Can I add info to SGE's internal accounting AFTER job submittal?
I'm writing a front-end script to enable users to simply submit and query jobs to a gridengine cluster. Specifically, we want to be able to display via this script info about all of the queues ...
-1
votes
1
answer
834
views
How can I fix SGE jobs stuck in queue
We are using Son of Grid Engine 8.1.8 on a grid of Debian 7.8 machines installed from deb packages. This has been working well until today, when a user submitted a processing stream, but all parts end ...