Questions tagged [gridengine]
Grid Engine is a distributed resource management (DRM) system that manages the distribution of users' workloads to available compute resources.
74
questions
2
votes
1
answer
259
views
sge: How to set hard limits of node?
The guy who administrates our cluster died suddenly and recently, so now we have to operate it ourselves until a new guy comes in. We want to change the hard runtime limit of a node on our cluster. ...
- 1,834
1
vote
1
answer
2k
views
Setting enviromental variables for login shells under root account in FreeBSD
I am currently in the process of configuring Open Grid Scheduler in FreeBSD. As part of this process I need to set the environmental variableSGE_ROOTas root.
To do this I have been experimenting with ...
CommunityBot
- 1
1
vote
0
answers
23
views
How to limit the master host using 1 slot for each job on gridengine?
I run the gridengine on my cluster and like to have a master queue where each job can only have 1 slot on the master host. but i do not find the way to configure this.
I learned that resource limits ...
- 8,926
1
vote
0
answers
62
views
View/request instruction sets available on SGE host
How can I view or request hosts that can handle a particular instruction set in SGE?
With Slurm, to view available instruction sets on each host I can use
sinfo --Node -o '%n %f',
and to submit a ...
- 111
25
votes
3
answers
39k
views
What are the differences between wall clock time, user time and cpu time
We are running computing jobs with GridEngine. Every jobs returns 3 different times:
Wall clock time
User time
CPU time
What are the differences between these three? Which of these three is most ...
- 21
0
votes
1
answer
139
views
How to create a SGE queue which can only be assigned jobs manually?
I have 5 nodes in an SGE cluster. I'd like to make it so one of those nodes can only be used by a specific queue, "test.q".
I can remove that node from hostlist on all of my other queues, and set ...
- 113
0
votes
1
answer
99
views
How to allow concurrent execution of job arrays with job share (-js)
I'm trying to have SGE run job array tasks concurrently based on the job shares parameter of qsub but it seems not to be working as expected. Is there a way to enable concurrent task execution based ...
- 376
1
vote
2
answers
17k
views
Sun Grid Engine set memory requirements per jobs
I want to be able to set up memory requirements per job.
For instance:
to run 5 jobs, for which I know each will need 4 GB memory. I have 16 GB RAM on the Ubuntu server and 16 GB swap. I want to ...
- 1,058
4
votes
2
answers
9k
views
What is the difference between h_rss and h_vmem in Sun Grid Engine (SGE)?
So far as I understood,
mem_free can be specified to submit a job in a host that has the
memory free = mem_free, whereas
h_vmem is the hard limit of the memory up to which the job can consume and ...
- 56
0
votes
1
answer
8k
views
SGE Grid Engine error "qsub: Unknown option"
I submit a job to SGE using the qsub command and get the error:
qsub: Unknown option
What unknown option?
- 225
0
votes
1
answer
63
views
How to make grid master "accept" gone hosts?
With gridengine-master 6.2u5-7.3 (Ubuntu Trusty), our /var/lib/gridengine/spool/qmaster/messages gets constantly filled with:
12/07/2016 04:11:43|worker|tools-grid-master|E|got load report of unknown ...
- 183
1
vote
1
answer
1k
views
Trying to get qsub to work on my cluster
Trying to get qsub to work on my cluster (single node right now but more are coming) So far trying to submit with qsub was returning
error: commlib error: got select error (Connection refused)
...
CommunityBot
- 1
0
votes
1
answer
93
views
SGE/OGS 2011 breaking Ansys Workbench Mechanical launch due to network port blocked
We are running a SGE / OGS compute cluster on EL6 and are trying to launch an interactive Ansys Workbench. This works using SSH with X Forwarding, but using qrsh fails to run the Mechanical component -...
- 16
1
vote
1
answer
441
views
qdel deletes all my jobs
I'm using Sun GridEngine (Rocks Cluster) on a server to run remote jobs.
When I try to remove jobs with qdel, it often works as expected, but every now and then it just deletes almost everything it ...
- 1,159
2
votes
1
answer
2k
views
Why is there concept of slots in SGE?
According to SGE 5.3 Manual,
Slots - The number of jobs which may be executed concurrently in that queue
I am new to these concepts and want to start by understanding one by one.
For suppose, if ...
- 376
0
votes
1
answer
859
views
How to get statistics about pending jobs in a specific SGE queue (e.g. using qacct)?
I know I can use qacct to get all kind of statistics about running jobs. Now is there a way get some statistics about how many jobs are pending and how long do they need to wait on average?
Bonus ...
- 376
0
votes
1
answer
449
views
Reserving slots in an SGE parallel environment
I'm trying to set up a Parallel Environment in SGE, with allocation rule $pe_slots, but I'm having trouble with the scheduler.
Single-core jobs hog the slots; there are never enough slots open at one ...
- 376
0
votes
1
answer
2k
views
qsub is working but qrsh fails and only when resources are specified explicitly with -l. Why?
I am getting the following error while submitting a simple interactive job to open a shell: qrsh -V -cwd -verbose -q nsnel6.q -l h_vmem=12.000G tcsh
local configuration arslox51 not defined - using ...
- 751
8
votes
1
answer
15k
views
Track memory usage of a job on SGE
I'm looking for some guidance in how to precisely figure out how much RAM my job is using on my cluster. My job is not multi-threaded and runs on a single cpu.
When I run my job and run "top" I can ...
CommunityBot
- 1
0
votes
1
answer
315
views
How to submit job from compute node to another compute node?
Currently I am working on a SGE cluster, and I could submit jobs using qsub in the head node, but what I want to do now is to create new jobs and submit jobs from one compute node to another, is it ...
- 11
2
votes
1
answer
1k
views
Set up SGE to Fill Each Node Completely Rather than Distribute Jobs
Originally posted on Stack Overflow by mistake... See PS at bottom for response from that post.
I've search for this a while, but cannot find the answer. The problem I have is this: assume I have a ...
- 376
1
vote
1
answer
3k
views
How do I recover a Berkeley DB (included in a Sun Grid Engine installation)?
I'm on CentOS 5.
[root@newjanux spooldb]# uname -a
Linux newjanux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux
and SGE 6.2u2
I already have copies of the ...
CommunityBot
- 1
-1
votes
1
answer
836
views
How can I fix SGE jobs stuck in queue
We are using Son of Grid Engine 8.1.8 on a grid of Debian 7.8 machines installed from deb packages. This has been working well until today, when a user submitted a processing stream, but all parts end ...
6
votes
7
answers
12k
views
How to reserve complete nodes on Sun Grid Engine?
How do you use SGE to reserve complete nodes on a cluster?
I don't want 2 processors from one machine, 3 processors from another, and so on. I have a quadcore cluster and I want to reserve 4 ...
- 4,403
1
vote
0
answers
125
views
SGE qsub concatenate different requests for different hosts
I wonder it is possible to concatenate multiple requests for different hosts in SGE qsub command? For example, I tried this:
qsub -l h="compute-0-[0-9]" -pe smp 6 -l h="compute-0-2[0-9]" -pe smp 4
...
- 111
0
votes
1
answer
450
views
How to set up SGE for following scheduling: "try first to run in queue A, if no A-slots available, try to run in queue B"?
Assume you have two queues, queue A with some new hardware, and queue B with old hardware. Further, both queues have the same number of nodes and slots for SGE jobs, e.g. 10 slots per queue.
Now I ...
- 688
0
votes
1
answer
185
views
Sun Grid Engine Dynamic resource allocation
My cluster is running Sun's Grid Engine version "GE 6.2u5 $Date: 2009/12/01 12:24:06 $". I'd like to submit a single job to the queue which is defined by a bash script containing a number of commands. ...
1
vote
1
answer
158
views
OGE no value for load_avg
There is a problem with my OGE configuration. The load_avg for the nodes does not get set (remains at -NA-). Because of this and because of the np_load_avg threshold on the queue no jobs are being run....
- 121
3
votes
1
answer
4k
views
Trying to install Sun Grid Engine on Ubuntu 10.04 - can't connect more execution hosts
I'm using Ubuntu 10.04 and trying to install Sun Grid Engine from Ubuntu repesitory. It works on single machine, I can submit jobs etc. But I can't make it working with any other machine. I added ...
CommunityBot
- 1
0
votes
2
answers
2k
views
High Low priority queues SGE
I would like to have two queues in a CPU/GPU cluster, one with high priority and one with low priority. Thus, jobs that are submitted in the high priority queue will be bumped to the top of the list ...
- 81
1
vote
1
answer
2k
views
How to get your qsub script information that you submitted before? [closed]
Since qstat only shows limited information, see the following as an example. But I want to know the details of a job AAA (say it was submitted by qsub sample, this sample script I guess must be stored ...
- 11
4
votes
1
answer
334
views
What does the qstat output jclass mean?
What does the qstat output jclass mean?
$ qstat -help
UGE 8.1.4
$ qstat -u myusername
job-ID prior name user state submit/start at queue jclass ...
- 80.4k
0
votes
2
answers
3k
views
Parallel Environment (PE) on Sun Grid Engine (6.2u5) won't run jobs: "only offers 0 slots"
I have Sun Grid Engine set up (version 6.2u5) on a Ubuntu 10.10 server with 8 cores. In order to be able to reserve multiple slots, I have a parallel environment (PE) set up like this:
pe_name ...
- 376
0
votes
1
answer
758
views
How do I impose a slot limit for sge on my user without manager rights?
On our cluster I could use up all the slots with the current configuration of sge. I don't want to overuse my privileges by accident / check at every submit.
Is there a way to impose a hard limit on ...
CommunityBot
- 1
0
votes
1
answer
116
views
Sun Grid Engine : jobs are not well balanced
I use Open Grid Scheduler (a fork/copy of Sun Grid Engine).
I have tried this configuration from master:
# qconf -mattr exechost complex_values slots=8 slave2
# qconf -mq all.q | grep slots
slots ...
- 376
2
votes
0
answers
206
views
Programmatically add EC2 execute nodes to Grid Engine cluster
I am running Grid Scheduler (fka Sun Grid Engine) on Amazon Web Services. Master node is running all the time, but I want to programmatically add nodes to the cluster (also remove - but remove is not ...
- 553
5
votes
4
answers
12k
views
Howto set up SGE for CUDA devices?
I'm currently facing the problem of integrating GPU-Servers into an existing SGE environment. Using google I found some examples of Clusters where this has been set up but no information on how this ...
13
votes
2
answers
562
views
Sun Grid Engine huhohshdhjha
when I type qstat -h, I get the following option
[-s {p|r|s|z|hu|ho|hs|hd|hj|ha|h|a}] show pending, running, suspended, zombie jobs,
jobs with a user/operator/...
CommunityBot
- 1
2
votes
1
answer
731
views
Is there a way to tell SGE to run specific jobs as root on the execution node?
The title kinda says it all...
We're using SGE/OGE to submit jobs to a set of worker nodes that then do things with specific pieces of equipment. The programs and scripts that have been created that ...
CommunityBot
- 1
1
vote
1
answer
2k
views
alternatives to SGE [closed]
Once upon at time there was the free SGE from Sun. tricky to install and configure, but functional and free.
Now we've got:
open source packages on Ubuntu that don't quite work out of the box (...
- 1,069
1
vote
1
answer
151
views
SGE: downtime planning
I need to plan a downtime for a maintenance of my environment (or some part of my environment) by means of Sun Grid Engine. Is it possible to somehow use backfilling information to tell the grid ...
- 12.3k
0
votes
1
answer
1k
views
SGE Auto configured consumable resource?
I am using a tool called starcluster http://star.mit.edu/cluster to boot up an SGE configured cluster in the amazon cloud. The problem is that it doesn't seem to be configured with any pre-set ...
- 123
2
votes
0
answers
2k
views
Sun Grid Engine (SGE) / limiting simultaneous array job sub-tasks
I am installing a Sun Grid Engine environment and I have a scheduler limit that I can't quite figure out how to implement.
My users will create array jobs that have hundreds of sub-tasks. I would ...
CommunityBot
- 1
1
vote
0
answers
87
views
systemimager and sun grid engine queuing system
I'm about to install our new cluster. I've installed the first node and used it for golden-image. As a queuing software we use SGE (Sun Grid Engine).
After installing of the first node I tested ...
- 31k
1
vote
2
answers
258
views
Build parallel processing grid from 32-bit desktops
I am running simulation on my laptop(Core 2 Duo 1.8Ghz with 4GB RAM running windows 7) which is taking very long time.
I have a couple of unused 32-bit (Core 2 Duo 1.8Ghz with 4GB RAM) desktops.
I ...
- 69.1k
1
vote
1
answer
96
views
Grid Engine Resource Requirement
Does anyone know about setting a requirement to use a particular cluster node. I have a server with 128G of RAM that I'd like to sit idle until a user specifically requests something like -l h_vmem=...
- 12.3k
0
votes
1
answer
217
views
Sun Grid Engine VNC temporary sessions
Since I've been in a world of hurt with FreeNX attempting to get shadowing to work, I stumbled across a brief description describing starting vnc sessions through an SGE job (our firewall rules would ...
CommunityBot
- 1
1
vote
2
answers
1k
views
Using CUDA_VISIBLE_DEVICES with sge
Using sge with resource complex called 'gpu.q' that allows resource management of gpu devices (these are all nvidia devices). However on the systems there are multiple gpu devices (in exclusive mode) ...
2
votes
1
answer
144
views
qsub: How can I find out what DRM middleware exactly is installed on a cluster?
I have a user account on a very big cluster. I have previous experience with Grid Engine and want to use the cluster for array jobs.
The documentation tells me to use "qsub" for load balancing / ...
- 2,567
2
votes
1
answer
597
views
Prevent users running processes on cluster head node
What ways are there to prevent users from starting long running, resource intensive processes on the headnode of a Rocks cluster?
I've tried:
asking politely
setting the nice level in limits.conf ...
- 12.3k