Lustre is an Open Source, high performance, parallel, highly scalable distributed file system.

learn more… | top users | synonyms

3
votes
1answer
417 views

What makes Lustre faster and more scalable than NFS?

I have read in various places (e.g. here and here) that NFS' I/O performance does not scale, while Lustre's does, and that Lustre can deliver better I/O rates in general. There seem to be various ...
3
votes
1answer
380 views

Which is the fastest way to move 1Petabyte from one storage to a new one?

First of all, thanks for reading, and sorry for asking something related to my job. I understand that this is something that I should solve by myself but as you will see its something a bit difficult. ...
3
votes
1answer
49 views

load balancing in multiple hardware raid arrays - soft raid 0 acceptable?

We have a central storage server (PowerEdge R720) serving shared files to an HPC cluster, and it has two hardware RAID controllers attached (PERC H810, each driving 2 MD1200 enclosures filled with ...
2
votes
1answer
416 views

Are snapshots and clones filesystem-wide in ZFS-backed Lustre clusters

My goal is to find a distributed filesystem on Linux that supports ZFS-like lightweight snapshots and snapshot clones. This StackOverflow question expresses what I'm looking for pretty well. I'm ...
2
votes
0answers
34 views

Lustre alternative for 70-node scientific cluster

Our lab has a cluster with 70 compute nodes 4 IO nodes Infiniband QDR interconnection 12T disk array accessed using IB SRP protocol The major application is debugging and running MPI-based ...
2
votes
0answers
43 views

What are the various factors that limits disk read and write speeds and on a network? [closed]

How to choose a server which: has high I/O performance of storage is highly flexible in terms of adding more storage So, basically these servers should act as storage servers for OST in lustre ...
2
votes
1answer
404 views

Beowulf cluster storage setup [closed]

I'm a Computer Engineering student working on a project with a Verari blade cluster, a bit outdated for today standards. I had acquired some Unix experience but I'm not an expert at all. This Verari ...
1
vote
1answer
39 views

Parallel filesystem which schedules simultaneous file requests to mutually exclusive sets of OSSs

My environment is RHEL based, interconnect is infiniband. I have some experience with Lustre. What i want to know is: Is there a parallel file-system, where if simultaneous write request arrive, ...
0
votes
2answers
41 views

Is it possible to have a directly attached SHARED Storage (accessed at block level) other than SAN or NAS?

We need storage specifically for HPC Lustre failover setup, where it is must that two servers should share same block level storage to have failover configuration. With very limited knowledge on ...
0
votes
1answer
229 views

Mongodb over Lustre?

I need to install a mongodb instance with a lot of data storage. We have a Lustre FS with hundreds of terabytes, but when monogdb start show me this error: Mon Jul 15 12:06:50.898 [initandlisten] ...
0
votes
1answer
73 views

How do we configure Lustre to block client requests when under load, rather than failing?

We are using Lustre in a cluster with approximately 200TB of storage, 12 Object Storage Targets (that connect to a DDN storage system using QDR Infiniband), and roughly 160 quad and 8-core compute ...
0
votes
1answer
273 views

MySQL files on Lustre?

Our MySQL installation stores several Tb of data that doesn't get accessed too often. Over the next six months we're going to be moving to a Lustre based system for much of our data storage and Im ...
0
votes
0answers
5 views

How to restripe lustre folders?

I'm using a lustre filesystem. We noticed one of the folder isn't striped. Is there a simple way to stripe the folder? We normally copy the data off. Set the stripe and then copy the files back onto ...
0
votes
1answer
844 views

Change the Hard Drive in RAID using tw_cli while lustre file system is mounted

I've setup RAID-5 array disk, but recently one of the Hard drives is reallocating excessive sectors: (Reallocated Sectors = 323) # tw_cli /c0/p1 show all /c0/p1 Status = OK /c0/p1 Model = ...
0
votes
1answer
143 views

Lustre OST physical volume failure

What happens when the physical volume of an OST is irrecoverably lost? What data is lost? Only the data stored on this OST, or everything? And, if the first is true, how can one control what data is ...
0
votes
1answer
851 views

Lustre - issues with simple setup

Issue: I'm trying to assess the (possible) use of Lustre for our group. To this end I've been trying to create a simple system to explore the nuances. I can't seem to get past the 'llmount.sh' test ...