Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.

learn more… | top users | synonyms

8
votes
5answers
30k views

Disabling RAID feature on HP Smart Array P400

I'm planning to use ZFS on my system (HP ML370 G5, Smart Array P400, 8 SAS disk). I want ZFS to manage all disks individually, so it can utilize better scheduling (i.e. I want to use software RAID ...
8
votes
3answers
3k views

Backup storage server with ZFS

I am IT everything man at a small company. I want to design a new infrastructure including a new server and a separate backup server with company wide backup policy. The most important thing in the ...
8
votes
2answers
6k views

Can different drive speeds and sizes be used in a hardware RAID configuration w/o affecting performance?

Specifically, I have a RAID 1 array configuration with two 500gb 7200rpm SATA drives mirrored as logical drive 1 (a) and two of the same mirrored as logical drive 2 (b). I'd like to add two 1tb ...
8
votes
1answer
22k views

KVM guest io is much slower than host io: is that normal?

I have a Qemu-KVM host system setup on CentOS 6.3. Four 1TB SATA HDDs working in Software RAID10. Guest CentOS 6.3 is installed on separate LVM. People say that they see guest performance almost equal ...
8
votes
6answers
34k views

SATA drives in HP ProLiant server?

Does anyone know if I can install normal 2.5" SATA drives inside an HP DL360 G5 server? Right now it has 6 72GB SAS drives. I am looking for raw storage for my files SAS performance in not required.
8
votes
7answers
5k views

How do you limit the use of network storage in your company?

I think this is one area that is a pain for every sysadmin. Users don't really know how much storage space they are using, and don't take the time to manage what is stored there, or how long it stays ...
8
votes
2answers
8k views

VMware ESXi SSD on RAID showing as non-ssd

I am replacing a KVM server with a ESXi server. I just installed ESXi 5.5u1 and added a data store. The new server has 4 SSD drives in RAID 6 using hardware RAID. When I added the data store VMware ...
8
votes
6answers
3k views

Effecient organization of spare cables and hardware

As many of you also likely do, I have a growing collection of cables, hardware, and spare parts (screws, connectors, etc.). I'm looking to find a good system of organization so that everything isn't a ...
8
votes
1answer
5k views

mdadm and 4k sectors (advanced format)

There are numerous questions on Serverfault about aligning 4k sectors disks, but one thing is not really clear to me yet. I successfully aligned my RAID1+LVM. One of the things I did was use mdadm ...
8
votes
2answers
245 views

Array free space requirement

The general rule of thumb is don't use more than 80-85% of your capacity, otherwise performance degrades sharply, and other bad stuff may happen. On a 8TB array, this comes out to around 1.6TB of ...
8
votes
2answers
4k views

How to get checksum data integrity on ext4?

On file systems like btrfs you can preform a scrub, which will go though all the data to see if the data still matches the file system checksum. I would like to check the data on ext4 if it is ...
8
votes
2answers
11k views

Slow disk performance on Azure Virtual Machine

Okay, so first of all, allow me to say that I'm not an operations person, but a developer. So I'm going into a bit of unknown land here, so please bear with me. I would like to use a Azure Virtual ...
8
votes
2answers
279 views

A roundrobin for incoming files

A bunch of new files with unique filenames regularly "appears"1 on one server. (Like hundreds GBs of new data daily, solution should be scalable to terabytes. Each file is several megabytes large, up ...
8
votes
2answers
2k views

Adding new virtual disks to a RHEL host in ESX “live”

I'm sure I've just missed which tutorial/manual page covers this, but how do you add get the guest OS to recognize that you've added new drives to it without a reboot? I have a RHEL5 guest running on ...
8
votes
2answers
553 views

Are branded backplanes useable without specific controllers?

I can't find a disk enclosure which I like, so I'm going to build a custom one (if nothing else, that'll teach me to be picky...). I've got a few HP SAS backplanes lying about, but I'm wondering if ...
8
votes
2answers
36k views

Fibre Channel LUN rescan and QLogic

I have a serious problem with a SAN storage array connected to a Linux box through Fibre Channel. Here is the configuration : Debian with plain vanilla linux 2.6.27.25 Fibre controller QLogic 4Gb ...
7
votes
6answers
3k views

hardware recommendations for a DIY storage system based on ZFS [closed]

Looking to make use of old server lying idle as a proof-of-concept ...here are specs Dell PE 2900: Xeon 5110 - 2P, 12 GB RAM, 8x 300 GB 15K drives, Perc 5i+256 MB cache what additional h/w would be ...
7
votes
16answers
6k views

Cheap but Highly Available Shared Storage? [closed]

my group is in the market for plentiful storage. We traditionally used big-iron FC-attached SANs, but they are way expensive and provide much more performance than we require. We want highly ...
7
votes
3answers
26k views

Measure Linux IOPS for a running system

How do I measure IOPS of a running Linux server? I know that the theoretical IOPS of a SATA drive is around 90 and enterprise 10k SAS/FC disk is 180. I want to know how much my running system is using ...
7
votes
6answers
1k views

solution to store 10TB /Month

I'm working at a small TV company. They generates 11TB of video files per month. What can I do?. I just need ordinary SATA disks, in RAID. What solution should I buy? (They are using a lot of ...
7
votes
5answers
30k views

How do I get my HP servers to email me when a drive fails?

Ideally, with as simple of install as possible and without requiring rebooting the servers. Mostly for DL380 G5's if it helps. Thanks.
7
votes
12answers
6k views

Best way to build home NAS with redundancy [closed]

I need a NAS device for my home network to get these high value files off my laptop (family photos, music, coding projects, etc.). My goal is cheap and reliable. I have a spare old PC laying around ...
7
votes
3answers
1k views

What is the use-case for NAS on a mid-to-high end storage array?

Many large storage vendors (EMC, NetApp, etc) provide storage equipment that does NAS in addition to FCP, FCoE, or iSCSI. When would it be appropriate to use the NAS functionality of these boxes? In ...
7
votes
6answers
4k views

Truecrypt: File vs Device hosted encryption

TrueCrypt allows the user to create an encryption volume on a file or a device hosted encryption on a drive or partition.What is advantage or disadvantage of one over the other?
7
votes
4answers
311 views

Does orientation during storage affect CD-ROM or DVD lifespans?

Related: Does orientation affect hard drive lifespan? I have been told that optical media must be placed in the horizontal position during storage, the theory being that gravity can affect the ...
7
votes
2answers
808 views

Server Rack vs. Server in PC “Towers”

A friend of mine told me that the company he made an internship at didn't have server racks, because the cooling just takes up too much energy and thus isn't effective. That company was using "normal" ...
7
votes
5answers
771 views

How should we serve files in a small bioinformatics cluster?

We have a small cluster of six ubuntu servers. We run bioinformatics analyses on these clusters. Each analysis takes about 24 hours to complete, each core i7 server can handle 2 at a time, takes as ...
7
votes
2answers
358 views

Storage issues: Prolonging the life of a legacy Compaq ML370

I have an original ML370, from before there even were generations (2000). The storage system is comprised of a Smart Array 431 controller, 2 9.1 Gb Ultra3 SCSI (COMPAQ BD009635C3), and 4 146.8 Gb ...
7
votes
3answers
1k views

Recommendations: configuring a 10GbE NAS stack for virtualisation storage

I'll try as hard as I can to word this so it is not considered a shopping list. We have been successfully running a dev/test ESXi environment for some time, with a couple of Dell PE2950III servers ...
7
votes
5answers
1k views

ML350 G5 - upgrade hot swap drives to 6 Gb/s?

I support a non profit. They got an ML350 G5 donated to them and I immediately put it to good use for them :) It came with four HP 300GB 15K SAS drives - and of course, they have all now failed. I ...
7
votes
3answers
472 views

Hard disk write-once mode on Windows

Is it possible to force a hard disk into 'write-once' mode in Windows? I want to securely store logs so they can't be changed, but I can't use tapes or optical media due to performance reasons.
7
votes
1answer
11k views

Why does “eager” vs “lazy” zeroing take much longer when provisioning a VM from a template?

Slightly related to a previous question about thick vs thin provisioning, why does eager zeroing the to-be-cloned VM take longer than lazy zeroing? For example, in a recent test we ran, an eager-...
7
votes
2answers
5k views

2012R2 Storage Spaces Memory and CPU requirements

I am looking at possibly using Storage Spaces in Server 2012R2 to build a NAS off of. I am looking to build a fairly large unit, 12-14 HDDs, in a "RAID10" like setup (I know storage spaces does not do ...
7
votes
1answer
1k views

VMWare ESX and guest settings for Netapp cluster failover

If I'm running VMWare 5.x on FC [edit] LUNs presented from a Netapp running ontap 8.x in 7 mode, what steps should I take to ensure that the VMs can withstand a worst possible case cluster node ...
7
votes
1answer
2k views

IQN Naming convention

I've seen a lot of information about how IQN's should be formatted, but there's not a lot of information on how to build them. I'm kind of a newb when it comes to iSCSI, and i have it working, but I'm ...
7
votes
5answers
3k views

Block-level LUN replication options for Windows [closed]

When it comes to replicating a LUN or partition to a physically separate server, Linux has DRBD (now in the kernel!). As I understand it, it has both synchronous and asynchronous replication modes. ...
7
votes
8answers
814 views

How to store terabytes of large, randomly accessed files?

Lets say I have a couple of thousand large files (1-800mb each), that are all accessed at random, with newly uploaded files accessed very frequently, and as time passes, the access times drops off in ...
7
votes
1answer
248 views

Protecting Network attached storage

In your answers, please keep in mind that it is all about a home network. What is the best way of protecting a network attached storage from the outside world? Currently i have a NAS connected ...
7
votes
1answer
795 views

Which block sizes for millions of small files

I have 2x 4TB Disks in hardware RAID1 (it might be a LSI MegaRaid) on Debian Wheezy. The physical block size is 4kB. I'm going to store 150-200 million of small files (between 3 and 10kB). I'm not ...
7
votes
1answer
178 views

Disk size addressable by the OS

I have a 3ware 9550SXU-12 storage controller and 750G disks connected to it. The disks are configured as single units (not JBOD). I've been running some performance tests, mainly to see the impact of ...
6
votes
3answers
21k views

What is the difference between a HBA card and a RAID card?

I thought I knew the difference between HBA and RAID. In my mind, HBA is offloading from the main motherboard/CPU and is simply JBOD... usually has an external SAS ports, whilst a RAID card does the ...
6
votes
8answers
3k views

What are SAS external storage options (Promise, Infortrend, SuperMircro, …)?

We are looking for a ~32T external storage solution for two 48-core AMD servers. These will be used for a small Linux OpenVZ cloud for CPU intensive web-servers and data warehousing. Dual path with ...
6
votes
10answers
352 views

On-line file storage? [closed]

Anyone that know of an on-line file storage that could be used to replace the functionality of a network file server? Background: We have a small decentralized company. We use version control (...
6
votes
4answers
263 views

Storage Architecture

Related to this question: When building a storage area network, do storage administrators generally create the physical disk arrays based on I/O type (sequential versus random access) and provision ...
6
votes
2answers
4k views

Does adding more drives to a RAID 10 Array increase performance?

I'd like to know if I were to add additional drives to an existing Raid 10 if this would increase the speed of the entire array?
6
votes
3answers
2k views

With 200TB of needed storage, is a SAN a good idea?

My employer has, what I consider to be, a lot of data. We currently have about 10TB of data on our NAS, which is about its capacity, and we would have more data on it if we didn't constantly move ...
6
votes
5answers
880 views

LUNs and virtual machines

I have HP P2000 + XenServer solution working. What I'm thinking about is how to create LUNs for 20 virtual machines. Separate LUN for every VM ? It gives me ability to backup the specific virtual ...
6
votes
3answers
1k views

What are the typical methods used to scale up/out email storage servers?

What I've tried: I have two email storage architectures. Old and new. Old: courier-imapds on several (18+) 1TB-storage servers. If one of them show signs of running out of disk space, we migrate ...
6
votes
4answers
373 views

Is DAS OK for under-utilised virtual machines?

We're a little behind in the virtualization game, I'll have to admit. We currently have nothing virtualized, but I'm trying to change that. We want to get our feet wet with virtualization and get a ...
6
votes
3answers
2k views

Dell MD1000 and an x4 SAS connector throughput / layout

I'm trying to get my head around how a multi lane x4 SAS connector works in a DAS system such as the Dell MD1000. I understand that each lane is 3Gbps, and that multiple hard drives can share a lane. ...