Questions tagged [torque]
TORQUE is a fork of OpenPBS, a job scheduling application used to distribute workloads within a UNIX-based computing cluster.
30
questions
0
votes
0
answers
21
views
torque/undelivered - collect finished jobs
I had the problem that due to an incorrectly configured ssh the pbs_mom couldn't send the finished data (.ER and .OU files) back to the server. After a look into the log, I could locate the data on ...
- 21
2
votes
1
answer
210
views
How can I set up interactive-job-only or batch-job-only partition on a SLURM cluster?
I'm managing a PBS/torque HPC cluster, and now I'm setting up another cluster with SLURM. On the PBS cluster, I can set a queue to accept only interactive jobs by qmgr -c "set queue interactive_q ...
- 143
1
vote
0
answers
44
views
Assigning CPU and MEM usage variables in PBS/TORQUE
I asked this question at meta.stackoverflow.com; they said it was the wrong forum
I am using the FALCON assembler (for genomes by PacBio; https://github.com/PacificBiosciences/pb-assembly) and it's ...
- 111
0
votes
1
answer
106
views
Less CPUload with torque
We have installed torque on a dual Xeon (26 core, 52 available in hyperthreading). The node is configured with np=104. If I launch a MPI calculation in command line, I get near 100% cpu usage :
%Cpu(...
0
votes
1
answer
137
views
Solution for dynamic allocation of CPU cores for MPI program
I am using a MPI program on limited CPU resources. It involved running an application that requires 20 separate processes on a 12 thread CPU. I run it again and again with different parameters.
...
- 13
1
vote
1
answer
281
views
Running tensorflow code in torque job
I have a cluster running with torque to distribute jobs. I want to run a job with tensorflow code and I am having problems with tensorflow not being recognized.
I installed tensorflow on my LDAP user ...
- 121
0
votes
1
answer
769
views
How to append PBS job output to log files instead of overwriting it?
I'm using Torque and I want my PBS log+error output to be appended to previous log/error file instead of overwriting it.
- 13
0
votes
1
answer
52
views
Library not found only when application is executed from PBS file.
I have a compiled file a.out that runs fine when executed directly from my terminal. However, trying to execute that file from my PBS file yields a missing library libmkl_intel_lp64.so. I have already ...
- 13
2
votes
1
answer
1k
views
Job submitted to Torque does not generate error/log file
As stated, I have just installed Torque on a Ubuntu 16.04 machine. The submitted jobs complete just fine but the -e and -o flags seem to not be working. No error and log files are created even though ...
- 13
1
vote
0
answers
524
views
How to setup bash environment inside Torque PBS? Why source ~/.bashrc doesn't work?
I have successfully installed Torque PBS on my ubuntu server. Job submission is fine. However there is an annoying thing. I found bash environment is not right inside PBS
for example
echo 'echo $...
- 121
1
vote
0
answers
351
views
PBS Torque Limit Resource by Time of Day
I am using Torque to manage software that I have a limited number of licenses of (4 to be exact). During the day I need to keep 2 licenses free for use of setting up cases and at night and over the ...
- 111
2
votes
0
answers
77
views
Torque pbs queue system runs queue in reverse
I have a small compute cluster set up on Redhat 7.1.
It runs the PBS torque queue system with version 5.1.1.
When I queue several jobs it starts to run the jobs in "backwards" priority. It starts ...
- 21
1
vote
0
answers
109
views
Torque queue issue
I am having troubles with Torque + Maui.
The problem is the following:
I have 2 queues, each queue has 10 associated nodes.
If i submit 10k jobs to the first queue and i submit 1 job to the second ...
- 11
-1
votes
1
answer
1k
views
How can we configure torque with multiple nodes for a workstation? [closed]
I've got a GPU workstation with 48 core CPU + 4 NVIDIA GPU. I am going to make this machine to be a small cluster which contains:
4 nodes
12 core +1 CPU/node
I've installed Torque in this machine ...
0
votes
1
answer
731
views
prevent normal users from running code on a cluster outside of pbs system
In our cluster with PBS batch system (torque) installed, we wish all the users execute their jobs by qsub so that the CPU resources can be well managed. However, it is found that users in our cluster ...
- 101
0
votes
1
answer
2k
views
Torque reports error when posting job to client nodes
The system has two machines, one (called macondo02) runs pbs_server and pbs_schedule, another (called macondo01) runs pbs_mom. I have ensured that the host can clearly identify the existance of the ...
- 101
3
votes
0
answers
264
views
Email notifications per JOB ARRAY not per job in PBS torque
Is there a way to configure torque to send email notifications on start and end of job array, and not per job, Im managing job arrays of thousands of jobs, and I dont want to get flooded by mails. But ...
- 31
1
vote
1
answer
2k
views
Why does qdel comman return 'Unknown Job Id'
OS Version:
CentOS release 4.6 (Final) Kernel \r on an \m 2.6.9-100.ELsmp
Problem
When I run qdel i get the following error:
qdel: Unknown Job Id 20432.scyld.localdomain
Information
Output of ...
1
vote
5
answers
16k
views
I get the error qsub: Bad UID for job execution when trying to submit a job via PBS
OS Version:
CentOS release 4.6 (Final)
Kernel \r on an \m
2.6.9-100.ELsmp
When I attempt to run a job it gives me the error as follows.
qsub: Bad UID for job execution
I have created a fresh user ...
-1
votes
1
answer
123
views
Torque: How lock node cores to one application [closed]
I am having an issue that I do not know how to solve. Say I have 2 nodes (node1 and node2) each with 24 cores, I have software where I have a license for 32 cores. I want to be able to configure ...
- 1
5
votes
0
answers
6k
views
torque pbs 4.0.1 job stays queued ('Q') state; the scheduler seems not receiving any notification
I am using torque 4.0.1 on openSUSE 12.1 in a cluster environment. When I qsub a job (simple as "echo hello"), it remains in 'Q' state, and never gets scheduled. I can force the job to run with qrun, ...
- 51
2
votes
1
answer
131
views
qsub: How can I find out what DRM middleware exactly is installed on a cluster?
I have a user account on a very big cluster. I have previous experience with Grid Engine and want to use the cluster for array jobs.
The documentation tells me to use "qsub" for load balancing / ...
user116990
1
vote
1
answer
2k
views
Torque and maui node status
I am new for torque and maui.
I was checking for node state to looking for which nodes are free and which nodes are in use.
For torque one command is pbsnodes. Which gives status and other info ...
- 255
1
vote
1
answer
895
views
Non-exclusive job scheduling in PBS/Torque
The cluster resource manager Torque typically allocates compute nodes on an exclusive basis. However, when you have a lot of small jobs (like we do) running against multi-core compute nodes, this can ...
- 1,281
30
votes
6
answers
7k
views
Outgrowing cron: what's the next scheduler? [closed]
We've been using cron for about as long as I can remember to handle all of our job scheduling needs. Everything from storage clones/snapshots to reports against databases to daily system reports to ...
- 23.9k
3
votes
2
answers
5k
views
Torque jobs does not enter "E" state (unless "qrun")
Jobs I add to the queue stays there in "Queued" state without attempts to be executed (unless I manually qrun them)
/var/spool/torque/server_logs say just
04/11/2011 12:43:27;0100;PBS_Server;Job;16....
- 821
1
vote
2
answers
3k
views
Torque works half of the time. Fails No Permission the other half
We upgraded our OS from Debian 5 to Debian 6 and consequently upgraded Torque.
Now qstat and qsub works for about 1 minute and fails for another minute.
I have torque-2.5.5 (but I tried 2.4.8 and it ...
- 2,395
0
votes
3
answers
933
views
Parallel prologue and epilogue in Grid Engine
We have a cluster being used to run MPI jobs for a customer. Previously this cluster used Torque as the scheduler, but we are transitioning to Grid Engine 6.2u5 (for some other features). ...
- 1,281
0
votes
1
answer
4k
views
Installing Torque on a single machine
Does anyone know if I can install Torque on a multicore machine instead of across a cluster? We're looking to test some software that requires Torque and exceeds the hardware capability of our LSF ...
- 151
0
votes
1
answer
438
views
Only half of my pbs/Torque jobs are being scheduled
My supercomputing center recently moved from SGE to pbs/Torque. Now, when I schedule my array jobs, only half of the jobs in the array get scheduled. When they finish, the other half get scheduled. ...
- 1,938