3
votes
1answer
150 views

Filesystem performance degraded during RAID rebuilding

So quick question - our RAID6 array is currently rebuilding and there is a VERY noticeable filesystem performance hit (home directories are NFS mounted on the array). I'd sort of expect that, given ...
0
votes
1answer
91 views

Are there performance or reliability concerns when spanning an LVM partition across multiple 2TB RAID virtual disks?

I'm preparing a Dell R520 PowerEdge server with 8x 1TB disks as a data archive/warehouse (file, RDBMS, NoSQL) server. Out of the box, the PERC H710P RAID controller was configured with 3x 2TB RAID6 ...
7
votes
1answer
237 views

Which block sizes for millions of small files

I have 2x 4TB Disks in hardware RAID1 (it might be a LSI MegaRaid) on Debian Wheezy. The physical block size is 4kB. I'm going to store 150-200 million of small files (between 3 and 10kB). I'm not ...
0
votes
2answers
124 views

Expandable Linux filesystem w/ redundancy & support for different drive sizes?

I did a bit of research already and didn't come across any filesystems so far that have the following features: Expandability, Redundancy, and the ability to utilize the full capacity of different ...
0
votes
2answers
565 views

Fedora, fsck fails at boot

I'm facing a problem in my server during the startup. This is my actual configuration: 320GB each. Raid1 -> /dev/md127. Working. /dev/sda /dev/sdc 1000GB each. Raid1 -> Use to be /dev/md126, ...
0
votes
0answers
35 views

How to rearange disks with a new SSD

Here is the problem: I have a Debian server with only 4 disk bays. At the moment there are 4 x 1GB SATA disks in software RAID 10. I'd like to swap one of the SATAs with a 1GB SSD disk and move the OS ...
3
votes
1answer
1k views

Converting BTRFS filesystem to RAID1 fails with “Inappropriate ioctl for device”

I had a ~1.6TB BTRFS volume on a single partition, to which successfully I added another freshly created and formatted partition (on another device) of exact same size with the intent of mirroring ...
0
votes
2answers
34 views

Scripted partition creation

I need to routinely do these steps on various machines that have the same hardware: delete any partitions on /dev/sda create a 100G primary partition on /dev/sda change partition type of created ...
-2
votes
4answers
419 views

How can I create one big volume from multiple drives, but loose only the files stored on one disk if it fails?

I am running a storage system. Fault tolerancy is handled at application level (files are stored on multiple servers, even datacenters). Therefore I don't need nor even want redundancy within one ...
6
votes
1answer
1k views

Does ZFS replace the need for hardware/software RAID?

I want to provide protection against data loss on my servers. Typically, I'd use hardware RAID 1 or 5, but I've been reading up on ZFS. Is it correct that ZFS itself provides RAID 1 or 5 like data ...
3
votes
2answers
280 views

Join multiple filesystems (on multiple computers) into one big volume

Scenario: Have 10 computers, each have 12x2TB HDDs (currently) in raidZ2 (10+2) configuration, so, in the each computer i have one approx. 20TB volume. Now, need those 10 separate computers ...
2
votes
2answers
2k views

Linux-on-Linux KVM: Which filesystem should i use for guest and host?

I'm in the process on playing around with kvm and setting up a linux on a linux-server, so i can reboot the (guest)server encrypt the rootFS of the guest without having to do initramfs-tricks to get ...
0
votes
0answers
982 views

Can't mount logical volume, RAID/MD/LVM problems

I have a file server with 48 2TB HDDs split across 2x 3ware 9650SE-24M8 RAID cards. Both cards have 24 drives in RAID 1+0. MD softraid is setup in raid 0 with the two RAID 1+0s making RAID 100. LVM2 ...
0
votes
1answer
161 views

Trade reliability for speed in a slow filesystem

On my box running Ubuntu Server 11.10 I have a rather slow soft RAID6 array on four USB sticks (and no other means for persistent storage). I want a faster filesystem on that box. I'm OK if I'd lose ...
1
vote
1answer
1k views

prevent filesystem from entering read-only mode

I have found that my server's filesystem is continuously entering read-only mode. There have been some issues with the raid1 array, but I have removed the bad disk from the array. However, it is ...
-3
votes
1answer
121 views

Disk buffer: why does it even exist in many disk controllers? [closed]

When you request disk for data, it usually first gets transferred to the disk buffer in the disk controller, and then it gets sent up to RAM (and thus stored in memory). I was just wondering what the ...
1
vote
1answer
827 views

rebuild raid array mdadm command

I have created a raid array say RAID5 or RAID10 with four drives. I wish to force resync of the same array, Please let me know the mdadm command for the same. Also, in case of RAID1 (mirroring) what ...
0
votes
7answers
4k views

Good filesystem for 20TB hardware-controlled RAID5 array?

What's the best file system for Ubuntu 10.10 assuming the average filesize is 8-30GB with no more than 1-2 users accessing the array at any given time?
1
vote
1answer
161 views

Erratic write patterns with linux md RAID1

I'm experiencing strange write performance patterns on a RAID1 array of SATA disks. My kernel is vanilla 2.6.37 and my server has 32G RAM. I'm copying a 32G file from an XFS filesystem on a SAS drive ...
0
votes
1answer
353 views

Replicated filesystem and EC2 MySQL

I'm currently investigating migrating our infrastructure over to run on Amazon's EC2 and am trying to figure out the best way to set up a MySQL service. I'm leaning towards running our own MySQL ...
1
vote
3answers
362 views

linux raid 1 to lvm or not to lvm

I am getting ready to create a (hardware) RAID 1 array spanning three disks. Performance is not key here, just redundancy and ability to recover from data failure. The question: Should I use LVM? ...
2
votes
2answers
637 views

perf tuning for ESX vmfs3 on RAID

looking for recommendations on ESX4 OS - VMFS version3: RAID-5 : matching the stripe size with VMFS block size? (64K, 128K etc) RAID controller options: "adaptive read ahead, write-back" on PERC 6i ...
3
votes
4answers
7k views

Windows file server performance tuning

I seek your opinion and tips/suggestions in optimizing the performance of a new Windows file server I'm building. I've inherited a Dell NF500 storage server (basically Dell 2950 with Windows 2k3 ...
1
vote
4answers
869 views

Recommended raid setup for a 500Gb RedHat/PostgreSQL server

I'd like some advice on common ways, if there is such a thing, to set up the partitions and raid on a RHAS5.3 server running postgressql which is expected to maintain a 500Gb database. The database ...
16
votes
8answers
1k views

Optimal UNIX File System Partition + Setup Strategy

When partitioning a new system disk(s) for UNIX, what is your prefered strategy for both desktop and/or servers? Please include disk partition layout, file system format(s) and options, mount points, ...