0
votes
1answer
29 views

Running jobs in a HPC cluster [closed]

I'm quite new to HPC environment. Is there any difference in running a job on a node utilizing 8 cores and running the same job on 8 nodes utilizing I core in terms of performance or walltime used. ...
6
votes
1answer
602 views

XFS Adding Quotas - Skip Quota check on first mount/boot

We run a 14TB XFS fileserver on our cluster and want to add quota support. This is running 3.9.2-1.el6.elrepo.x86_64 kernel under CentOS 6.3 (Final). The issue is when we unmount the XFS RAID, and ...
0
votes
0answers
68 views

Microsoft HPC: mixing windows and linux blades

I have a working Windows HPC cluster with 32 blades, all of them are using Windows HPC. My question is: can I install Linux on 16 blades and keep the other 16 on Windows? Is there a specific version ...
1
vote
3answers
159 views

Appropriate network file system for huge (5+ Gb) files

I've got a number of servers used for HPC / cluster computing and I noticed that, given the fact that part of the computations they run use huge files over NFS, this causes significant bottlenecks. ...
8
votes
6answers
1k views

How to allow users to transfer files to other users on linux

We have an environment of a few thousand users running applications on about 40 clusters ranging in size from 20 compute nodes to 98,000 compute nodes. Users on these systems generate massive files ...
3
votes
1answer
284 views

Which is the fastest way to move 1Petabyte from one storage to a new one?

First of all, thanks for reading, and sorry for asking something related to my job. I understand that this is something that I should solve by myself but as you will see its something a bit difficult. ...
0
votes
0answers
162 views

Lustre I/O server goes down without cpu being loaded, I/O server which takes the backup service goes 100% cpu and performance goes down.

I'm having something that I can not understand. I quite new on lustre. n4 and n5 are two I/O servers, each one taking care of different datasets. When one of them goes down, the other is supposed to ...
2
votes
1answer
292 views

Management of available file descriptors within a Hadoop cluster

I'm currently in charge of a rapidly-growing Hadoop cluster for my employer, currently built upon release 0.21.0 with CentOS as the OS for each worker and master node. I've worked through most of the ...
4
votes
1answer
420 views

Why are most supercomputer using linux? [closed]

Referring to this BBC Article: Supercomputing superpowers Almost all the supercomputers are using Linux as operating system. Why is Linux so popular?
4
votes
3answers
484 views

Is this a HPC or HA mySQL cluster?

Can someone tell me if this is a High Performance Compute or High Available mySQL cluster? There is a picture of the setup. This is part of the config.ini they talk about [ndbd default] ...
1
vote
2answers
297 views

WEB based HPC cluster node management

i am working on my school diploma thesis. The main goal is to create web based application where logged users could see free and busy nodes, turn them on and off, see what process they are running ...
3
votes
1answer
470 views

What applications can be used in a Red Hat/CentOS cluster?

When I look at the Red Hat cluster manuals 1 2, they only explain how to install it but not what applications can use it. I am new to clusters, so I don't know these things =) Let's say I want to 3 ...
2
votes
5answers
510 views

setting up a cluster

I have 5 PC(s) connected over a LAN through a switch. I want to connect them to form a HPC cluster. The OS may be any Linux version (currently I have installed Ubuntu 8.10, 9.10 and Fedora 10) Purpose ...