Questions tagged [gridengine]

Grid Engine is a distributed resource management (DRM) system that manages the distribution of users' workloads to available compute resources.

18 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2 votes
0 answers
206 views

Programmatically add EC2 execute nodes to Grid Engine cluster

I am running Grid Scheduler (fka Sun Grid Engine) on Amazon Web Services. Master node is running all the time, but I want to programmatically add nodes to the cluster (also remove - but remove is not ...
Felix's user avatar
  • 553
2 votes
1 answer
596 views

Prevent users running processes on cluster head node

What ways are there to prevent users from starting long running, resource intensive processes on the headnode of a Rocks cluster? I've tried: asking politely setting the nice level in limits.conf ...
pufferfish's user avatar
  • 2,890
2 votes
0 answers
2k views

Sun Grid Engine (SGE) / limiting simultaneous array job sub-tasks

I am installing a Sun Grid Engine environment and I have a scheduler limit that I can't quite figure out how to implement. My users will create array jobs that have hundreds of sub-tasks. I would ...
wfaulk's user avatar
  • 6,958
1 vote
0 answers
23 views

How to limit the master host using 1 slot for each job on gridengine?

I run the gridengine on my cluster and like to have a master queue where each job can only have 1 slot on the master host. but i do not find the way to configure this. I learned that resource limits ...
It's Joh's user avatar
1 vote
0 answers
61 views

View/request instruction sets available on SGE host

How can I view or request hosts that can handle a particular instruction set in SGE? With Slurm, to view available instruction sets on each host I can use sinfo --Node -o '%n %f', and to submit a ...
Richard Border's user avatar
1 vote
1 answer
1k views

Trying to get qsub to work on my cluster

Trying to get qsub to work on my cluster (single node right now but more are coming) So far trying to submit with qsub was returning error: commlib error: got select error (Connection refused) ...
OMRY VOLK's user avatar
  • 111
1 vote
0 answers
125 views

SGE qsub concatenate different requests for different hosts

I wonder it is possible to concatenate multiple requests for different hosts in SGE qsub command? For example, I tried this: qsub -l h="compute-0-[0-9]" -pe smp 6 -l h="compute-0-2[0-9]" -pe smp 4 ...
Youngman's user avatar
  • 111
1 vote
1 answer
2k views

Setting enviromental variables for login shells under root account in FreeBSD

I am currently in the process of configuring Open Grid Scheduler in FreeBSD. As part of this process I need to set the environmental variableSGE_ROOTas root. To do this I have been experimenting with ...
user avatar
1 vote
0 answers
87 views

systemimager and sun grid engine queuing system

I'm about to install our new cluster. I've installed the first node and used it for golden-image. As a queuing software we use SGE (Sun Grid Engine). After installing of the first node I tested ...
Kris_R's user avatar
  • 305
1 vote
1 answer
229 views

OpenMPI in SGE fails when not observed

I know the topic is weird but so is my problem. On our cluster we have SGE with OpenMPI compiled for tight integration. When I set it up it worked just fine in my tests and so far there have been no ...
luxifer's user avatar
  • 177
1 vote
1 answer
482 views

How to limit jobs in an indicated queue in SGE

I have two queues in SGE for different purposes. Each of them has a limit in slots. What I want is to have only a certain number of jobs submitted to a queue waiting even when the other queue is idle. ...
Chaolin Zhang's user avatar
0 votes
1 answer
139 views

How to create a SGE queue which can only be assigned jobs manually?

I have 5 nodes in an SGE cluster. I'd like to make it so one of those nodes can only be used by a specific queue, "test.q". I can remove that node from hostlist on all of my other queues, and set ...
Daniel's user avatar
  • 113
0 votes
1 answer
98 views

How to allow concurrent execution of job arrays with job share (-js)

I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based ...
a1an's user avatar
  • 457
0 votes
1 answer
63 views

How to make grid master "accept" gone hosts?

With gridengine-master 6.2u5-7.3 (Ubuntu Trusty), our /var/lib/gridengine/spool/qmaster/messages gets constantly filled with: 12/07/2016 04:11:43|worker|tools-grid-master|E|got load report of unknown ...
Tim Landscheidt's user avatar
0 votes
1 answer
182 views

Sun Grid Engine Dynamic resource allocation

My cluster is running Sun's Grid Engine version "GE 6.2u5 $Date: 2009/12/01 12:24:06 $". I'd like to submit a single job to the queue which is defined by a bash script containing a number of commands. ...
Grey Christoforo's user avatar
0 votes
1 answer
116 views

Sun Grid Engine : jobs are not well balanced

I use Open Grid Scheduler (a fork/copy of Sun Grid Engine). I have tried this configuration from master: # qconf -mattr exechost complex_values slots=8 slave2 # qconf -mq all.q | grep slots slots ...
GlinesMome's user avatar
0 votes
1 answer
125 views

Can I add info to SGE's internal accounting AFTER job submittal?

I'm writing a front-end script to enable users to simply submit and query jobs to a gridengine cluster. Specifically, we want to be able to display via this script info about all of the queues ...
Rick Reynolds's user avatar
-1 votes
1 answer
834 views

How can I fix SGE jobs stuck in queue

We are using Son of Grid Engine 8.1.8 on a grid of Debian 7.8 machines installed from deb packages. This has been working well until today, when a user submitted a processing stream, but all parts end ...
user2997577's user avatar