Grid Engine is a distributed resource management (DRM) system that manages the distribution of users' workloads to available compute resources.

learn more… | top users | synonyms

0
votes
1answer
67 views

Setting enviromental variables for login shells under root account in FreeBSD

I am currently in the process of configuring Open Grid Scheduler in FreeBSD. As part of this process I need to set the environmental variableSGE_ROOTas root. To do this I have been experimenting with ...
1
vote
0answers
56 views

Programmatically add EC2 execute nodes to Grid Engine cluster

I am running Grid Scheduler (fka Sun Grid Engine) on Amazon Web Services. Master node is running all the time, but I want to programmatically add nodes to the cluster (also remove - but remove is not ...
0
votes
1answer
302 views

How do I recover a Berkeley DB (included in a Sun Grid Engine installation)?

I'm on CentOS 5. [root@newjanux spooldb]# uname -a Linux newjanux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux and SGE 6.2u2 I already have copies of the ...
0
votes
1answer
49 views

Sun Grid Engine : jobs are not well balanced

I use Open Grid Scheduler (a fork/copy of Sun Grid Engine). I have tried this configuration from master: # qconf -mattr exechost complex_values slots=8 slave2 # qconf -mq all.q | grep slots slots ...
0
votes
1answer
69 views

How do I impose a slot limit for sge on my user without manager rights?

On our cluster I could use up all the slots with the current configuration of sge. I don't want to overuse my privileges by accident / check at every submit. Is there a way to impose a hard limit on ...
12
votes
2answers
181 views

Sun Grid Engine huhohshdhjha

when I type qstat -h, I get the following option [-s {p|r|s|z|hu|ho|hs|hd|hj|ha|h|a}] show pending, running, suspended, zombie jobs, jobs with a ...
1
vote
1answer
90 views

qdel deletes all my jobs

I'm using Sun GridEngine (Rocks Cluster) on a server to run remote jobs. When I try to remove jobs with qdel, it often works as expected, but every now and then it just deletes almost everything it ...
1
vote
1answer
72 views

SGE: downtime planning

I need to plan a downtime for a maintenance of my environment (or some part of my environment) by means of Sun Grid Engine. Is it possible to somehow use backfilling information to tell the grid ...
1
vote
0answers
39 views

Application Priority jobs sun grid engine

I have five compute node and five application my question is if i submit job 1 application then job will go on compute-0-0 and if compute-0-0 is no slot and other nodes are free then job will run on ...
0
votes
1answer
58 views

parallel environment, grid mis-computing memory consumption by dis regarding shared memory of children processes?

We have an application that takes large amount of RAM for execution. To execute in parallel, this application also forks out copies of itself that perform multiple dedicated tasks. During fork, we ...
1
vote
0answers
71 views

systemimager and sun grid engine queuing system

I'm about to install our new cluster. I've installed the first node and used it for golden-image. As a queuing software we use SGE (Sun Grid Engine). After installing of the first node I tested ...
1
vote
1answer
35 views

Grid Engine Resource Requirement

Does anyone know about setting a requirement to use a particular cluster node. I have a server with 128G of RAM that I'd like to sit idle until a user specifically requests something like -l ...
0
votes
1answer
104 views

Sun Grid Engine VNC temporary sessions

Since I've been in a world of hurt with FreeNX attempting to get shadowing to work, I stumbled across a brief description describing starting vnc sessions through an SGE job (our firewall rules would ...
3
votes
2answers
72 views

Are there cluster resource schedulers abstraction layers?

I'm writing an application that could potentially be run on any cluster resource scheduler (SGE, LSF or SLURM to name a few of them), using very basic functionalities. I'm wondering if a ...
2
votes
1answer
99 views

qsub: How can I find out what DRM middleware exactly is installed on a cluster?

I have a user account on a very big cluster. I have previous experience with Grid Engine and want to use the cluster for array jobs. The documentation tells me to use "qsub" for load balancing / ...
0
votes
2answers
401 views

Using CUDA_VISIBLE_DEVICES with sge

Using sge with resource complex called 'gpu.q' that allows resource management of gpu devices (these are all nvidia devices). However on the systems there are multiple gpu devices (in exclusive mode) ...
2
votes
1answer
386 views

Using ionice Over Cluster

Background: I use a computing cluster at work (4 slave nodes and 1 head node) that uses the SGE job scheduler. Recently we've been running jobs that do some heavy IO and it has been slowing down ...
1
vote
1answer
148 views

OpenMPI in SGE fails when not observed

I know the topic is weird but so is my problem. On our cluster we have SGE with OpenMPI compiled for tight integration. When I set it up it worked just fine in my tests and so far there have been no ...
1
vote
1answer
100 views

How to limit jobs in an indicated queue in SGE

I have two queues in SGE for different purposes. Each of them has a limit in slots. What I want is to have only a certain number of jobs submitted to a queue waiting even when the other queue is idle. ...
1
vote
2answers
117 views

Sun Grid Engine (SGE) Jobs Not Visible After Adding virtual_free

I'm trying to to use virtual_free to limit the number of large memory jobs running each grid node in my cluster. This seems to be working as expected. After I modified my code to submit jobs with the ...
2
votes
2answers
114 views

Is there a way to tell SGE to run specific jobs as root on the execution node?

The title kinda says it all... We're using SGE/OGE to submit jobs to a set of worker nodes that then do things with specific pieces of equipment. The programs and scripts that have been created that ...
0
votes
1answer
76 views

Can I add info to SGE's internal accounting AFTER job submittal?

I'm writing a front-end script to enable users to simply submit and query jobs to a gridengine cluster. Specifically, we want to be able to display via this script info about all of the queues ...
3
votes
5answers
2k views

Howto set up SGE for CUDA devices?

I'm currently facing the problem of integrating GPU-Servers into an existing SGE environment. Using google I found some examples of Clusters where this has been set up but no information on how this ...
3
votes
1answer
128 views

Is it a bad idea to add lots of machines as submit hosts in an SGE environment?

We're replacing a home-grown queueing system with SGE/OGE. The current work environment has engineers using their own local Linux workstation to submit jobs. So I'm wondering about adding many ...
2
votes
1answer
128 views

asynchronous job queueing in sun grid engine (SGE) - possible?

We are looking to deploy a queueing system, and SGE is looking like it will meet nearly all of our wishes. However, we had the idea of supporting both a synchronous and asynchronous queueing model. ...
0
votes
2answers
1k views

Parallel Environment (PE) on Sun Grid Engine (6.2u5) won't run jobs: “only offers 0 slots”

I have Sun Grid Engine set up (version 6.2u5) on a Ubuntu 10.10 server with 8 cores. In order to be able to reserve multiple slots, I have a parallel environment (PE) set up like this: pe_name ...
1
vote
2answers
378 views

alternatives to SGE

Once upon at time there was the free SGE from Sun. tricky to install and configure, but functional and free. Now we've got: open source packages on Ubuntu that don't quite work out of the box ...
1
vote
1answer
150 views

Sun GRID Engine - submit jobs that 'prefer the powerful' machine instead weaker machines

We have 10 windows machines under sun grid(single CPU/4G RAM). Except name, every thing else is same on all these machines. Now we added two new machines to same grid. These two have 16 CPU , 48G RAM. ...
2
votes
1answer
1k views

Overlapping queues on Sun Grid Engine?

We would like to have an SGE-based compute cluster with a queue that gives access to all nodes for the computational staff, and a second cluster queue that gives access to, say, half the nodes for ...
1
vote
1answer
465 views

SGE - limit a user to a certain host, using resource quota configuration

Is it possible to limit a user to a particular host, using the Resource Quota Configuration option in qmon for Sun Grid Engine? I'm thinking of a line to the effect of: { ... limit users {john} to ...
1
vote
2answers
141 views

Build parallel processing grid from 32-bit desktops

I am running simulation on my laptop(Core 2 Duo 1.8Ghz with 4GB RAM running windows 7) which is taking very long time. I have a couple of unused 32-bit (Core 2 Duo 1.8Ghz with 4GB RAM) desktops. I ...
2
votes
6answers
3k views

How to reserve complete nodes on Sun Grid Engine?

How do you use SGE to reserve complete nodes on a cluster? I don't want 2 processors from one machine, 3 processors from another, and so on. I have a quadcore cluster and I want to reserve 4 ...
3
votes
1answer
2k views

Kill an SGE job “already in deletion”, as user

Is there a way that my users can kill their own jobs that are stuck in the dr state? qstat -f <jobid> as the user, returns job <jobid> is already in deletion yet when run as root it ...
1
vote
1answer
195 views

Dynamically host allocation in sge

I have for example 20 computer cluster and 4 users. I want to provide users with 5 hosts (or N slots), but if not whole cluster is used users job can be run on other hosts/slots. It is possible in ...
0
votes
3answers
450 views

Parallel prologue and epilogue in Grid Engine

We have a cluster being used to run MPI jobs for a customer. Previously this cluster used Torque as the scheduler, but we are transitioning to Grid Engine 6.2u5 (for some other features). ...
1
vote
2answers
5k views

Sun Grid Engine set memory requirements per jobs

I want to be able to set up memory requirements per job. For instance: to run 5 jobs, for which I know each will need 4 GB memory. I have 16 GB RAM on the Ubuntu server and 16 GB swap. I want to ...
3
votes
2answers
189 views

Sun Grid Engine Array Job Individual Resources

Is it possible in Sun Grid Engine to have array jobs where each subtask has a unique requirement? For example I may have an array job for which each task has a small unique requirement but I do not ...
2
votes
1answer
612 views

How can one run a prologue script as root in gridengine?

In one of our compute clusters, we have systems with unique hardware resources to which access is controlled by device-file permissions. Each node has two or four of these, and multiple CPU cores. ...
8
votes
1answer
3k views

How can I set the maximum number of running jobs per user on SGE?

We're using SGE (Sun Grid Manager). We have some limitations on the total number of concurrent jobs from all users. I would like to know if it's possible to set a temporary, voluntary limit on the ...
1
vote
1answer
2k views

Trying to install Sun Grid Engine on Ubuntu 10.04 - can't connect more execution hosts

I'm using Ubuntu 10.04 and trying to install Sun Grid Engine from Ubuntu repesitory. It works on single machine, I can submit jobs etc. But I can't make it working with any other machine. I added ...
1
vote
1answer
312 views

SGE output and notification to the mail

in a SGE script with #$ -M my_mail@gmail.com #$ -m aes SGE send notify of job complete. how I can receive the output of the job with the this notification ?
1
vote
1answer
148 views

Which compute node did a Sun Grid Engine job execute on?

What is the easiest way to determine which node a compute job was executed on, using Sun Grid Engine? qstat seems to only list running/queued jobs
1
vote
1answer
206 views

How to specify the equivalent of ppn (on PBS) in SGE queuing system?

Is there a way to specify the ppn ( or equivalent ) in SGE ? i don't want to use all cpus in one node so i will be able to have more memory per core. ( In PBS you would do -l nodes=16:ppn=2 for ...
2
votes
4answers
517 views

Best way to monitor a Grid of computers?

I've installed Sun Grid Engine on 10 nodes, and one virtual master host. Now I have to monitor all the resources prior to launching it into production, but I don't know which is the best way. I've ...
1
vote
2answers
495 views

Sun Grid Engine: Automatically Terminating Idle Interactive Jobs

We're considering using Sun Grid Engine on a small compute cluster. Right now, the current set up is pretty crude and just involves having people ssh to an open machine to run their jobs. We'd like ...
1
vote
2answers
171 views

Security Concerns for High Performance Clusters

This is a VERY open question since this is my first time creating a cluster. I'm just wondering what type of security concerns will there be and how to prevent them. Background information Using SGE ...
3
votes
4answers
712 views

Multiple servers acting like a single one with all the hardware?

by now I have 10 servers for hpc, power computing oriented. My users need to launch several processes using qmake. The users are used to work with ubuntu 9.10, and the software from the repositories ...
2
votes
1answer
1k views

Sun Grid Engine (SGE) / limiting simultaneous array job sub-tasks

I am installing a Sun Grid Engine environment and I have a scheduler limit that I can't quite figure out how to implement. My users will create array jobs that have hundreds of sub-tasks. I would ...
3
votes
2answers
3k views

What are the differences between wall clock time, user time and cpu time

We are running computing jobs with GridEngine. Every jobs returns 3 different times: Wall clock time User time CPU time What are the differences between these three? Which of these three is most ...