XFS is a file system originally for SGI's IRIX OS, but is now available for Linux. It is known for handling large files and large file systems well, one of the few Linux file systems that can handle partitions over 16.8TB.
27
votes
11answers
14k views
ZFS vs XFS
We're considering building a ~16TB storage server. At the moment, we're considering both ZFS and XFS as filesystem. What are the advantages, disadvantages? What do we have to look for? Is there a ...
18
votes
1answer
2k views
Why are my XFS filesystems suddenly consuming more space and full of sparse files?
I've run XFS filesystems as data/growth partitions for nearly 10 years across various Linux servers.
I've noticed a strange phenomenon with recent CentOS/RHEL servers running version 6.2+.
Stable ...
15
votes
2answers
5k views
Production-ready, highly reliable filesystems on Linux: ext4 ext3 XFS or JFS (or ZFS)?
The last real question I've seen on this topic is from about two years ago (is ext4 ready for production usage).
In the intervening time, how has ext4 improved?
XFS, JFS, and ext3 are the standby ...
15
votes
2answers
1k views
Verify A Partition is Aligned in Linux With RAID and LVM
Does anyone know the steps to verify that a XFS filesystem on top of LVM and md RAID is properly aligned on an array of 4096 Byte aka "Advanced Format" sectored disks?
Some references are:
...
14
votes
2answers
997 views
The XFS filesystem is broken in RHEL/CentOS 6.x - What can I do about it?
Recent versions of RHEL/CentOS (EL6) brought some interesting changes to the XFS filesystem I've depended on heavily for over a decade. I spent part of last summer chasing down an XFS sparse file ...
13
votes
1answer
581 views
HP DL380p Gen8 (p420i controller) I/O oddity on XFS partitions
On DL380p gen8 servers using XFS on top of LVM on top of raid 1+0 with 6 disks, an identical workload results in a ten-fold increase in disk writes on RHEL 6 compared to RHEL 5, making applications ...
12
votes
2answers
530 views
Inode tables shrinking sharply over time causing rsync/inode problems
We setup a Linux (it's on Amazon AWS, a CentOS-like system although we are not exactly sure the customizations done on it) system with 4TB storage as an XFS volume over LVM (ultimately to be used for ...
10
votes
2answers
730 views
Adding 60TB Storage to an SLES 10 Server
I have to add some archive\staging storage to an SLES 10 Server. The requirement is to present fairly large volumes (9-20TB each approx, 60TB or so in total) that will be used to store archive data ...
9
votes
1answer
5k views
Easy to expand Linux software RAID 5 with XFS. Best practices?
I use my Ubuntu machine as a file server for Windows/Linux/Mac clients using a Samba share. I need it to be easily expandable by just adding more hard drives without having to move any data back and ...
7
votes
2answers
1k views
Large RAID stripe size wastes space with small files?
I'm planning a Maildir storage with RAID 0+1(or RAID 10, RAID 5) on XFS filesystem and XFS will be created with stripe unit and width that RAID will use.
I don't determine RAID stripe size yet, but ...
7
votes
2answers
2k views
CentOS 6 doing lots more IO than CentOS 5
I'm benchmarking an application on two identical servers, one is Centos 5.8 and the other is Centos 6.2. My application is running much slower (50% or less) on the Centos 6.2 machine.
In attempting ...
7
votes
4answers
2k views
Does putting the XFS log on an SSD significantly improve performance?
I have a five disk array running XFS in RAID5, and I would like to improve it's performance. I have seen some hints that putting the log onto a separate device can help, does putting the log onto an ...
7
votes
1answer
762 views
XFS: no space left on device, (but I have 850GB available!)
I'm using a combination of mdadm, lvm2, and XFS on Amazon EC2.
So far, I've had success running a RAID 5 volume built from a number of EBS volumes. The EBS volumes are attached and used with mdadm to ...
6
votes
1answer
154 views
The impact of a high directory-to-file ratio on XFS
We're building a product that is likely to generate very large XFS volumes, and I'm trying to discover the scaling bottlenecks we're likely to run into given the architecture.
As we manipulate files ...
5
votes
3answers
1k views
OpenSolaris ZFS barebones for NAS
I've been tasked to suggest a NAS replacement for our aging fileserver at work, its currently running Linux with XFS (using LVM).
We're a very small company of 5 folks, so we're using commodity ...
5
votes
3answers
4k views
How to corrupt a file system
I am going to be testing 'xfs_repair' on some large file systems ( around 50 TB ) as in the past the memory usage is high. While I could test the program only on file systems which were correct it ...
5
votes
3answers
372 views
Where is my space on /var being used?
I'm a novice linux admin and now responsible for the OS of a 3 node Tomcat cluster.
(Tomcat is handled by the DEVs luckily.)
I got alarmed by our monitoring solution that /var on server01 has only ...
5
votes
2answers
777 views
Modify XFS filesystem creation parameters during kickstart installation
I'm streamlining the kickstart process for a series of EL6.2 (RHEL, CentOS, SL, etc.) systems. I'd prefer to use XFS over ext4 for the growth/data partition. However, I'd like some control over the ...
5
votes
1answer
183 views
upgrading ext3 fs on ubuntu 8.04
so we are stuck with this closed source system that keeps on adding folders to one directory, and it's going to hit the 32k limit soon because it's ext3. and that folder is expected to have +100k ...
4
votes
6answers
3k views
Monitoring XFS filesystem health in Linux
I recently experienced a filesystem meltdown. I had a server running for about 180 days non stop without any issues, but then I noticed weird stuff happen and apparently the ext3 filesystem was in ...
4
votes
1answer
4k views
How can you shrink an XFS filesystem?
I have an xfs filesystem that has some free space. Can I shrink it? I know of xfs_growfs. And there is resize2fs and resize_reiserfs.
Side question: is xfs not a good filesystem choice for bulk ...
4
votes
1answer
770 views
How to format XFS parition if the stability is the most important thing
We want to use XFS to format some partitions in a server. High performance is of course our goal, but we prefer to stability firstly. For example, we want to recover the FS quickly if power failure ...
4
votes
2answers
2k views
It is XFS reliable? In case of a power gone off is xfs riskier that ext3 in data corruption/safey?
I have been having some electrical issues,mostly power going out suddenly for a few months,and although ups solve the thing mostly.
But still i am worried about filesystem corruption,and data lost.
...
4
votes
2answers
159 views
xfs: find files on the first 1 TB
I have been hit by xfs' No space left on device. According to the FAQ:
http://xfs.org/index.php/XFS_FAQ#Q:_Why_do_I_receive_No_space_left_on_device_after_xfs_growfs.3F
The only way to fix this is ...
4
votes
2answers
1k views
RAID Read/Write Speed Gradually Slows
This is actually a server at home, but I felt it was sufficiently complicated as to not have it on SuperUser and could easily apply to a professional situation.
I have a file server running Debian ...
4
votes
1answer
210 views
Disabling/Enabling Modules Parameter RHEL
I'm working with kernel module parameters, and I've found myself a bit confused.
In particular, I'm attempting to enable posix ACL support for XFS file systems. This requires the XFS module to be ...
3
votes
6answers
2k views
JFS or XFS or anything else?
After deciding to use LVM2 as volumemanager on our servers there was also the wish for an online resizeable filesystem. After reading a few articles I decided to use JFS in favour of XFS.
Now today I ...
3
votes
1answer
863 views
Mount XFS partition with < 4k block size
I have an XFS partition with a 64k blocksize. But I can only mount it in Ubuntu 10.10 when the blocksize is the default of 4k. How can I mount a partition with the larger blocksize?
This works:
...
3
votes
4answers
250 views
How can I reduce inode utilization on an ext4 filesystem?
Summary of My Need
We put a large amount of files on a filesystem for analysis at a later time. We can't control how many files we're going to have, and this one box needs access to all of them.
...
3
votes
2answers
425 views
Error growing XFS volume with xfs_growfs
I added another 8TB to my 20TB array and tried to expand it with xfs_growfs, no joy and no idea why it is failing. Much googleing has provided some answers but nothing that has worked.
I am at my ...
3
votes
1answer
597 views
XFS Check/Repair Fails
I have a mysql database server on an EC2 instance with 3 drives in a Raid 0 array. This morning the server crashed and after inspecting the logs, I noticed a Structure Needs Cleaning error(i.e. System ...
3
votes
1answer
93 views
Uneven utilization of disks in xfs-formatted logical volume
We have a backup server with 66TB of available space, set up like so:
12 6TB RAID10 arrays -> 12 PVs -> 1 VG -> 1 LV -> xfs
This filesystem is used exclusively for backups (through BackupPC). It ...
3
votes
1answer
984 views
XFS I/O Error accessing Logical Block 0 of an LVM snapshot: is the drive or snapshot bad?
I have OpenSuSE 11.3 running as a Xen host on a machine with 8x296GB Cheetah 15k.6 SAS disks, 4 of which are mirrored, the other 4 striped. I'm using LVM to manage the disks and they are formatted ...
2
votes
7answers
1k views
Filesystem for an external drive that'll only connect to Linux
I just bought a new 500GB external harddrive. Most of the time I only store operating system ISO's on those things and some movies. Large files anyway, well over 4GiB sometimes, so FAT is out of the ...
2
votes
3answers
376 views
Fastest way to chown a whole device (xfs)
I need to chown 1.5 million files on a drive. I'm currently doing:
sudo chown -R www-data:www-data /root-of-device
but it takes an awfully long time to run. I was wondering if there was some sort ...
2
votes
3answers
666 views
Raid-5 Performance per spindle scaling
So I am stuck in a corner, I have a storage project that is limited to 24 spindles, and requires heavy random Write (the corresponding read side is purely sequential). Needs every bit of space on my ...
2
votes
2answers
4k views
changing filesystem format from xfs to ext4 without losing data
I have a fresh Lucid Lynx (Ubuntu 10.04) running on a laptop. where I defined the filesystems as:
mount point / on ext4 (46 Gb)
mount point /home on jfs (63 GB)
swap as 3 Gb
I left the machine ...
2
votes
3answers
2k views
Ubuntu 9.10 cron script 'ec2-consistent-snapshot' unable to execute and access files
I have a Ubuntu 9.10 image running on Amazon EC2 and I've setup a backup script ec2-consisten-snapshot.
I'm able to run the script from SSH, and everything works peachy.
sudo ec2-consistent-snapshot ...
2
votes
1answer
160 views
get mkfs.xfs options from existing xfs filesystem
I set up a new server last week, did some testing with different mkfs.xfs options on mdadm raid5, i finally found some statisfying mkfs options.
Now i am about to set up a new server having exactly ...
2
votes
4answers
815 views
Store and backup 200 million small files
My disk are 10x1TB SAS 7200 RPM in a RAID 10 with a MegaRaid 9260 hardware controller with cache/BBU. This results in a 4.6TB RAID 10 volume. hdparm -t (when device is empty) results in 500MB/s.
RAID ...
2
votes
1answer
746 views
Corrupted XFS and no way to xfs_repair
One of my hosted server has some XFS problems. after the last crash, some of my RRD folders got corrupted.
example (sorry, it's in french):
# rm *
rm: impossible de supprimer « create_rrd.sh »: La ...
2
votes
4answers
703 views
Linux filesystem suggestion for MySQL with a 100% SELECT workload
I have a MySQL database that contains millions of rows per table and there are 9 tables in total. The database is fully populated, and all I am doing is reads i.e., there are no INSERTs or UPDATEs. ...
2
votes
1answer
122 views
Restrict file access to append only
I have a directory with log files and I'm putting
logs from script launched by users into them. Logging with syslog isn't
possible in this case.
I want the users to have only write permissions on ...
2
votes
3answers
529 views
EBS+RAID10+XFS slower than EBS+RAID10+EXT3 using MySQL?
We're currently using EC2 with 16 EBS volumes in RAID10 configuration for our MySQL data. I know some people don't recommend to put EBS volumes to RAID but that's not what I'm concerned about at the ...
2
votes
1answer
1k views
Resize XFS Partition (Increase)
I'm new to xfs and was wondering how to increase the size of /var and /home, I'm guessing xfs does not simply increase in size as needed...
Filesystem Type Size Used Avail Use% Mounted on
...
2
votes
2answers
3k views
Why won't xfs_check run?
I'm running a fully updated Ubuntu 9.04 "Jaunty" i686 server. I have an single XFS volume in an LVM group called /dev/mapper/vg0-bigthree.
If I boot to single user mode and ensure that the volume is ...
2
votes
1answer
50 views
When I mount an XFS snapshot that was frozen, do I need to unfreeze it?
I'm snapshotting an XFS EBS volume, freezing it first.
When I mount the snapshot as a new volume on a different instance will I need to unfreeze the volume before it can be used, or will it not be ...
2
votes
3answers
2k views
NFS / DRBD / XFS Performance issues
we have a NFS sitting on top of XFS and drbd which delivers us a horrible performance (about 1MB/s read / write as shown in iostat/iotop)
the xfs volume properties are:
meta-data=/dev/drbd0 ...
2
votes
1answer
399 views
Upgrading 32-bit XFS filesystem to 64-bit
What would be the procedure for upgrading XFS filesystems from 32-bit to 64-bit? What damage or issues would arise from accessing XFS fs that was formatted on a 32-bit OS with a 64-bit OS?
To ...
2
votes
2answers
1k views
Questions for Ext3/4 Features ( dir_index,filetype) and XFS File system Performance
I am developing an applications which reads huge list of directories and check file types using file command and using ext4 file system.
When i look into Ext4 , i see it have two interesting features
...
