Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [hpc]

High Performance Computing encompasses using "supercomputers" with high numbers of CPUs, large parallel storage systems and advanced networks to perform time-consuming calculations. Parallel algorithms and parallelization of storage are essential to this field, as well as issues with complex, fast networking fabrics such as Infiniband.

0
votes
1answer
46 views

What does “CPU Minutes” mean exactly?

I'm actually trying to report cluster utilization in Slurm but i don't understand the metric CPU Minutes. [root@XXXX]# sreport cluster Utilization Start=2018-12-01 End=2018-12-31 ---------------------...
0
votes
1answer
33 views

Exascale Power Consumption

I have read a lot of articles about exascale and found out that it may consumes approximately 20MW power envelope. Is it a daily basis or a yearly basis or every second? Please enlighten me. Here are ...
0
votes
1answer
167 views

Configure Singularity to do headless rendering / use OpenGL / glxgears / glxinfo

I want to do headless rendering on a server where I do not have root permissions. Therefore, I created a Singularity container like this: Bootstrap: docker From: nvidia/cuda:9.0-runtime-ubuntu16.04 %...
1
vote
1answer
653 views

Intel Xeon 6134 + One DIMM per channel or two DIMMs per channel for maximum memory bandwidth?

I'm unable to find this critical piece of information in spec sheets. Appreciate any insight. We're purchasing servers for HPC work with intel Xeon Gold 6134 (Skylake) cpus I want maximum memory ...
2
votes
1answer
47 views

Micosoft HPC Pack 2012 R2 does not run with Network Direct after joining new domain

I am working with a 13 computer cluster, running on Windows Server 2012 R2, using MS HPC Pack 2012 R2. The headnode is working properly. The servers are connected to the corporate network via IPv4 on ...
2
votes
1answer
33 views

Are processors more efficient at lower temperatures

I couldn't find a stackexchange site that's more suited for this question, I apologize. This doesn't necessarily have a lot to do with servers and stability.... I do not have problems with stability ...
0
votes
0answers
74 views

How to handle mpi head node failure?

There is app which starting with mpirun. If compute node fail then all processes crush, but if only head node fail(for example reboot) then processes will stuck on compute nodes. How to get rid of ...
2
votes
3answers
139 views

Randomize Slurm Node Allocation

Has anyone had luck randomizing Slurm node allocations? We have a small cluster of 12 nodes that could be used by anywhere from 1-8 people at a time with jobs of various size/length. When testing our ...
0
votes
0answers
52 views

HPC cluster head node RHEL 6.2 freezes

We have a problem with the head node of the High Performance Cluster (HPC) running RHEL 6.2. It must be powered off and on using power button, it freezes, no network, could not ping and SSH compute ...
2
votes
0answers
191 views

MAAS for diskless computational hpc cluster

I'm considering to use MAAS to deploy OS for a computational cluster. All nodes are diskless. Only head node and (probably) MAAS rack controller will have hard drives. It seems MAAS have to finish a ...
0
votes
0answers
21 views

Ideal configuration for a head node? [duplicate]

Which hardware should I concentrate on, when assembling a head node for an HPC cluster? The main task for the head node is to relay instructions to the compute nodes which will be running artificial ...
1
vote
1answer
197 views

ifconfig apparently showing wrong RX/TX values for InfiniBand HCA

Recently, I executed a watch -n 1 ipconfig on one of our Linux cluster computing nodes while it was running a 48-process MPI run, disributed over several nodes. Oddly, while Ethernet packets seem to ...
1
vote
2answers
195 views

Containers for HPC batch processing

We are facing the problem that a lot of people want to run different scientific software on our high performance computing cluster. Every user requires a different set of libraries and library ...
-4
votes
1answer
127 views

Solutions for monetizing excess CPU cycles [closed]

My company has a big (relatively) computer farm, say, 100 physical servers (dual CPU hexacore e5 xeons with 160 Gb RAM) leased from some hardware provider (say Leaseweb or OVM) on monthly basis, means,...
2
votes
1answer
79 views

How many infiniband adapters should be used in multi socket servers?

Should dual socket motherboards have an infinity band adapter for each CPU? That is, should there be two infiniband band adapters, one in each CPU's PCIe slot. Would this eliminate the signal going ...
0
votes
1answer
86 views

SSH vs qlogin to use all processors of a computing node

I have a SGE cluster consisting of four computing nodes, each with 20 processors. I do not mind to give one particular user the full capabilities of one specific node, i.e. I do not mind he/she uses ...
-2
votes
2answers
65 views

memory usage per user in SGE cluster

I would like to automate the estimation of monthly memory usage of all jobs performed by a given user in my cluster (SGE, ubuntu). I have seen there are many tools to compute the current memory usage ...
0
votes
0answers
15 views

Different compute schedulers running on VMs

I'm setting up a parallel computing cluster of about 15 nodes that will have to be shared by multiple research groups. Each group has their own software, licensing, and job scheduler requirements (...
1
vote
1answer
737 views

Slurm: Have two separate queues for GPU and CPU-only jobs

At the moment, we have set up Slurm to manage a small cluster of six nodes with four GPUs each. That has been working great so far, but now we want to utilize the Intel Core i7-5820K CPUs for jobs ...
-5
votes
1answer
44 views

why all hard drives in a HPC cluster must be of the same size and part number? [closed]

One of the hard drives of my HPCC is broken and I have to buy another one. I've heard it must be of the exactly same size and part number. Could anyone explain me why? Thanks
1
vote
0answers
91 views

Torque queue issue

I am having troubles with Torque + Maui. The problem is the following: I have 2 queues, each queue has 10 associated nodes. If i submit 10k jobs to the first queue and i submit 1 job to the second ...
0
votes
0answers
186 views

Deployment of Base-Node via iSCSI in Server 2012R2 HPC cluster fails (can not join domain)

We are currently evaluating Server 2012R2 with HPC Pack for an upcoming project. Sadly we are stuck at deploying the base node. The node boots via PXE (iPXE) and connects to iSCSI, installs Windows ...
1
vote
1answer
160 views

deploying base note for HPC cluster in server 2012R2 hangs

We are in the process of evaluating server 2012R2 standard with HPC pack for a small cluster of nodes (about 40 to start with - the current setup has only one compute node). For the moment we use old ...
10
votes
1answer
3k views

Why does requesting GPUs as a generic resource on a cluster running SLURM with the built-in plugin fail?

Disclaimer: This post is quite long as I tried to provide all relevant configuration information. Status and Problem: I adminster a gpu cluster and I want to use slurm for job management. ...
1
vote
1answer
85 views

No service for subscription

I am trying to set up bursting to Azure with a Windows HPC cluster. THe cluster already works fine and I can start jobs on the machines on that are on the local network. When I try and create a node ...
2
votes
2answers
201 views

Why configure cluster nodes to reboot when out of memory?

I have access to a research HPC cluster which is configured so that if your job tries to use more memory than the node has available the node crashes and automatically reboots. This appears to be ...
2
votes
1answer
128 views

Parallel Processing and Disk IO for performance. More cores or more servers?

I have a large analysis job on an AWS EC2 instance (c3.8xlarge) on Ubuntu 12.04. The objective is to load the server at 100% CPU, running as many jobs as memory allows (varying amounts but generally ...
2
votes
1answer
1k views

Building Windows server cluster hpc

I'm trying to set up a Windows Server cluster with a head node and 2x compute nodes. So far, i've managed to install : (thanks to this tutorial http://msdn.microsoft.com/en-us/library/jj884142.aspx) ...
2
votes
1answer
3k views

HPC Cluster (SLURM): recommended ways to set up a secure and stable system

I'm working with a SLURM driven HPC Cluster, containing of 1 control node and 34 computation nodes and since the current system is not exactly very stable I'm looking for guidelines or best practices ...
1
vote
1answer
40 views

Parallel filesystem which schedules simultaneous file requests to mutually exclusive sets of OSSs

My environment is RHEL based, interconnect is infiniband. I have some experience with Lustre. What i want to know is: Is there a parallel file-system, where if simultaneous write request arrive, ...
1
vote
1answer
373 views

Windows VMs on ScaleMP cluster?

I was wondering whether the following stack would work, and if so then how well, and what sort of problems I might expect to encounter when setting it up? Hardware layer - lots of cheap servers SMP ...
0
votes
2answers
3k views

Numerous pbs_server errors in /var/log/messages

On supercomputer's management node we receive numerous errors such as: pbs_server: LOG_ERROR::is_request, bad attempt to connect from 10.10.0.254:1023 (address not trusted - check entry in ...
1
vote
1answer
222 views

HPC / EC2 - optimizing NFS for relialibility

In AWS-EC2, I've set-up a cluster of linux virtual machines made of an NFS fileserver and many clients. If the number of clients is above ~20, under heavy I/O, I am experiencing loss of file integrity:...
0
votes
1answer
67 views

Running jobs in a HPC cluster [closed]

I'm quite new to HPC environment. Is there any difference in running a job on a node utilizing 8 cores and running the same job on 8 nodes utilizing I core in terms of performance or walltime used. ...
6
votes
1answer
4k views

XFS Adding Quotas - Skip Quota check on first mount/boot

We run a 14TB XFS fileserver on our cluster and want to add quota support. This is running 3.9.2-1.el6.elrepo.x86_64 kernel under CentOS 6.3 (Final). The issue is when we unmount the XFS RAID, and re-...
0
votes
0answers
114 views

Microsoft HPC: mixing windows and linux blades

I have a working Windows HPC cluster with 32 blades, all of them are using Windows HPC. My question is: can I install Linux on 16 blades and keep the other 16 on Windows? Is there a specific version ...
0
votes
2answers
414 views

Running ScaleMP on top of OpenStack [closed]

Looking for a feedback if anyone has already played with running ScaleMP linux appliances in OpenStack (KVM)? A short description of the setup (w/ or w/o InfiniBand, total amount of RAM, etc) and its ...
1
vote
3answers
216 views

Appropriate network file system for huge (5+ Gb) files

I've got a number of servers used for HPC / cluster computing and I noticed that, given the fact that part of the computations they run use huge files over NFS, this causes significant bottlenecks. I'...
0
votes
1answer
110 views

How do we configure Lustre to block client requests when under load, rather than failing?

We are using Lustre in a cluster with approximately 200TB of storage, 12 Object Storage Targets (that connect to a DDN storage system using QDR Infiniband), and roughly 160 quad and 8-core compute ...
6
votes
4answers
2k views

using i7 “gamer” cpu in a HPC cluster

I'm running WRF weather model. That's a ram intensive, highly parallel application. I need to build a HPC cluster for that. I use 10GB infiniband interconnect. WRF doesn't depends of core count, but ...
3
votes
2answers
1k views

Does Xeon Phi works with i7 CPUs

Does Xeon Phi coprossesors works with i7 CPUs ? It's advertised for use with Xeons, but for my app (WRF), i7-3930k performs better and is 3 times cheaper than high grade xeons. So I wonder if I could ...
1
vote
1answer
759 views

Open MPI can't launch remote nodes via SSH

I am trying to set up Open MPI between a few machines on out network. Open MPI works fine locally, but I just can't get it to work on a remote node. I can ssh into the remote machine (without password)...
2
votes
1answer
160 views

Microsoft HPC cluster - AD or AD LDS?

The instructions for deploying an HPC Cluster (e.g. step 1.5 on this page in TechNet) are very clear that HPC cluster nodes "must be members of an Active Directory domain". Does the Active Directory ...
3
votes
1answer
1k views

What makes Lustre faster and more scalable than NFS?

I have read in various places (e.g. here and here) that NFS' I/O performance does not scale, while Lustre's does, and that Lustre can deliver better I/O rates in general. There seem to be various ...
9
votes
5answers
6k views

How to allow users to transfer files to other users on linux

We have an environment of a few thousand users running applications on about 40 clusters ranging in size from 20 compute nodes to 98,000 compute nodes. Users on these systems generate massive files (...
4
votes
2answers
3k views

View Infiniband routing table generated by OpenSM?

As I understand it, the subnet manager of an Infiniband network calculates the best routes between each pair of nodes on the network and provides these routes to the nodes when they want to ...
3
votes
1answer
450 views

Which is the fastest way to move 1Petabyte from one storage to a new one?

First of all, thanks for reading, and sorry for asking something related to my job. I understand that this is something that I should solve by myself but as you will see its something a bit difficult. ...
1
vote
1answer
67 views

HPC OSS Node issue with unreadable local hdd error

We have a HPC setup with four OSS server(OSS1 to OSS4) and two MDS Nodes(MDS1 to MDS2) It has been running till yesterday without any problem. Today morning i found that OSS4 is in shutdown condition....
0
votes
1answer
67 views

Windows HPC Server 2008 R2 SP3 upgrade

It's not clear to me from reading the documentation if I must update the clients, or whether I can just update the head node and compute nodes. Does anyone have any experience of this? I don't want ...
1
vote
1answer
2k views

Torque and maui node status

I am new for torque and maui. I was checking for node state to looking for which nodes are free and which nodes are in use. For torque one command is pbsnodes. Which gives status and other info ...