ext3 is the default file system for many Linux distributions.

learn more… | top users | synonyms

53
votes
22answers
18k views

rm on a directory with millions of files

Background: physical server, about two years old, 7200-RPM SATA drives connected to a 3Ware RAID card, ext3 FS mounted noatime and data=ordered, not under crazy load, kernel 2.6.18-92.1.22.el5, uptime ...
24
votes
12answers
4k views

Storing and backing up 10 million files on Linux

I run a website where about 10 million files (book covers) are stored in 3 levels of subdirectories, ranging [0-f]: 0/0/0/ 0/0/1/ ... f/f/f/ This leads to around 2400 files per directory, which is ...
21
votes
9answers
20k views

Disk full, du tells different. How to further investigate?

I have a SCSI disk in a server (hardware Raid 1), 32G, ext3 filesytem. df tells me that the disk is 100% full. If I delete 1G this is correctly shown. However, if I run a du -h -x / then du tells me ...
21
votes
10answers
19k views

How to make `rm` faster on ext3/linux?

I have ext3 filesystem mounted with default options. On it I have some ~ 100GB files. Removal of any of such files takes long time (8 minutes) and causes a lot of io traffic, which increases load on ...
20
votes
9answers
16k views

Maximum number of files in one ext3 directory while still getting acceptable performance?

I have an application writing to an ext3 directory which over time has grown to roughly three million files. Needless to say, reading the file listing of this directory is unbearably slow. I don't ...
19
votes
3answers
19k views

How do you get e2fsck to show progress information?

I'm running e2fsk on a very large (1TB+) ext3 disk with e2fsck -v /dev/sda1 from RIPLinux booted with PXE. I get e2fsck 1.41.6 (30-May-2009) /dev/sda1 contains a file system with errors, check ...
17
votes
4answers
36k views

How do I determine the block size of an ext3 partition on Linux?

How do I determine the block size of an ext3 partition on Linux?
16
votes
2answers
7k views

Production-ready, highly reliable filesystems on Linux: ext4 ext3 XFS or JFS (or ZFS)?

The last real question I've seen on this topic is from about two years ago (is ext4 ready for production usage). In the intervening time, how has ext4 improved? XFS, JFS, and ext3 are the standby ...
15
votes
11answers
16k views

Filesystem large number of files in a single directory

OK, not so large but I need to use something where around 60,000 files with average size of 30kb are stored in a single directory (this is a requirement so can't simply break into sub-directories with ...
15
votes
1answer
3k views

From bad sector to “damaged file” - did it for Linux/ext3, can I do it for Windows/NTFS?

When a SMART check on a disk reports a bad sector, it is important to be able to identify the file that has the bad sector - and restore it from backups. Below, I show how I did this for my Linux/ext3 ...
13
votes
2answers
5k views

CentOS thinks Disk is busy, can't mount or fsck

I'm a longtime user, and first time question submitter. I've spent a full day searching this and many other sites for a solution, but I must resort to requesting assistance to resolve my situation. ...
13
votes
8answers
51k views

How do you re-mount an ext3 fs readwrite after it gets mounted readonly from a disk error?

Its a relatively common problem when something goes wrong in a SAN for ext3 to detect the disk write errors and remount the filesystem read-only. Thats all well and good, only when the SAN is fixed ...
12
votes
4answers
11k views

What Windows ext3 driver should I use? [closed]

I understand that there are several alternatives for using/accessing ext2/ext3 in Windows, such as those described in a HOWTO Forge article and in a another article from a year ago. However, none of ...
11
votes
6answers
21k views

What are the differences between ext3, ext4 , ReiserFS?

And why should I pick one instead of the other?
10
votes
10answers
799 views

How does the number of subdirectories impact drive read / write performance on Linux?

I've got an EXT3 formatted drive on a Linux CentOS server. This is a web app data drive and contains a directory for every user account ( there are 25,000 users ). Each folder contains files that ...
10
votes
2answers
7k views

Should we mount with data=writeback and barrier=0 on ext3?

We've been running a server on a VM at a hosting company, and have just signed up for a dedicated host (AMD Opteron 3250, 4 cores, 8GB RAM, 2 x 1TB in software RAID, ext3). While running performance ...
9
votes
2answers
1k views

Is post-sudden-power-loss filesystem corruption on an SSD drive's ext3 partition “expected behavior”?

My company makes an embedded Debian Linux device that boots from an ext3 partition on an internal SSD drive. Because the device is an embedded "black box", it is usually shut down the rude way, by ...
8
votes
2answers
12k views

How to tell the language encoding of a filename on Linux?

I have a directory with ~10,000 image files from an external source. Many of the filenames contain spaces and punctuation marks that are not DB friendly or Web friendly. I also want to append a SKU ...
8
votes
2answers
10k views

Running out of memory running fsck on large filesystems

I look after an old Debian linux box (running etch) with only 512 MB of RAM, but a lot of external storage attached. One ext3 filesystem is 2.7 TB in size, and fsck can't check it, because it runs ...
8
votes
1answer
4k views

ext3_dx_add_entry: Directory index full

Background: I'm running lighttpd 1.4.28-1 on CentOS 5.3 to serve the static assets. Signal: recently, it gets slow sometimes. I'm getting the below errors in the kernel log and /var/log/messages: ...
8
votes
4answers
5k views

ext3 fsck time versus partition size

I'm doing the setup for a large-scale storage farm, and to avoid the need for month-long fscks, my plan is to split the storage into numerous smaller filesystems (this is fine, as I have a ...
7
votes
5answers
8k views

How do I list a file's data blocks on Linux?

As I understand it, each file on a Unix-like operating system has an inode number (which can be viewed with "ls -i"), and each inode is a list of disk blocks that contain the actual data of a file. ...
7
votes
2answers
13k views

How long should resize2fs take on a 1TB partition?

I've got a new computer at the university and almost set up everything for myself on it when I've noticed that the previous user of the machine used a huge 1TB ext3 partition only. I usually keep ...
7
votes
4answers
22k views

kernel: journal commit I/O error

I am having some problems with a Dell 1950 server. I am installing RHEL 4.6 along with Oracle and some other software on here. I am randomly getting an error message saying "kernel: journal commit ...
7
votes
1answer
2k views

Best practices for choosing fs block size on ext3/4?

I never really pay block size much attention but obviously there can be benefits to choosing something other than the default. I am looking for a good "best practices" paper on choosing block size. ...
6
votes
3answers
457 views

DRBD configuration

I was going through the configuration of DRBD on two nodes. The DRBD has already configured, but I would like to enable the dual primary mode feature. On drbd site I have seen that it requires the ...
6
votes
5answers
1k views

How do I get transparent, efficient, file system snapshotting or versioning on ext3/4?

I've long thought about versioning file systems. This is a killer feature and I've looked at Wayback, ext3cow, zfs, fuse solutions, or just cvs/svn/git overlays. I consider ext3cow the model for my ...
6
votes
1answer
1k views

ext3 file system performance tuning: what metrics to monitor

I have a high-IO application that is working, and scaling well to date. Over the past few months we've been trying to look down the road and predict where our next bottlenecks will occur. One of ...
6
votes
4answers
2k views

Easiest way to corrupt ext3 file system (for testing)?

I need to corrupt ext3 file system (for testing purposes) to some repairable state. How that can be done?
5
votes
5answers
12k views

Best file system for media server? [closed]

I need some advice on what file system to use for my new 1TB media server hosted on my Linux box. I have a few requirements: Needs to be shareable to a different Windows machine (not dual booting, ...
5
votes
3answers
2k views

Convert a software raid volume from ext3 to ext4 (or ext2)?

I have an mdadm created software raid volume in my ubuntu linux 11 machine. It is NOT the boot drive. It is a software raid 5 configuration made from 3 large sata drives. When I created it ...
5
votes
3answers
3k views

CentOS disable filesystem check: superblock last mount time is in the future

I'm persistently getting the "Superblock last mount time is in the future" error when booting CentOS 6. I've seen other questions which ask how to resolve this error, but I know exactly why it's ...
5
votes
1answer
440 views

find file by block number on ext3 fs on lvm

smartd has detected a bad block on my hard drive and I'd like to know what file does that block belong to. I have ext3 filesystem on a logical volume. Google gave me a lot of tutorials (like this one: ...
5
votes
1answer
1k views

Why is ext3 so slow to delete large files?

I have a server, which makes an incremental backup of a system every night. Now on saturdays, there is a full backup. But after the full backup has finished, a script kicks in, that deletes the ...
5
votes
3answers
842 views

User reduced LVM logical volume without resizing filesystem

I received an email yesterday that one of our users was trying to make room for a heartbeat/clustering package which requires its own partition to act as a voting disk. To do this, he attempted to ...
5
votes
2answers
3k views

How do I mount ext2 or ext3 filesystems on OSX?

I would like to mount an ext2/3 filesystem on a mac running 10.5.
5
votes
4answers
3k views

Rsync -avzHP follows hardlinks instead of copying them as hardlinks

I use rsnapshot to create hourly/daily/weekly/monthly backups of my "work"-share. Now I'm trying to copy the whole backup-directory onto an external drive using rsync. I used this command/parameters ...
5
votes
3answers
122 views

directories with two one dot (.) entries

I'm trying to clean up my lost and found, and I've managed to remove most things, but I'm left with "almost" empty directories, like: lost+found/#14042862: total 1324 dr---wx--- 2 76040 43010 ...
5
votes
2answers
862 views

Apache's htcacheclean doesn't scale: How to tame a huge Apache disk_cache?

We have an Apache setup with a huge disk_cache (>500.000 entries, >50 GB disk space used). The cache grows by 16 GB every day. My problem is that the cache seems to be growing nearly as fast as it's ...
5
votes
2answers
253 views

Repartitioning while disk is in use?

I've two closely related questions, so I'll keep them in one SF question: Question 1 I've a Linux (debian) server that must have minimal downtime. The disk has two partitions, one is / (ext3) and ...
5
votes
2answers
148 views

Slower/cached Linux file system required

I know it sounds odd but I need a slower or cached filesystem. I have a lot of firewalls that are syslog'ing their data to a pair of Linux VMs which write these files to their 'local' (actually FC ...
5
votes
1answer
226 views

upgrading ext3 fs on ubuntu 8.04

so we are stuck with this closed source system that keeps on adding folders to one directory, and it's going to hit the 32k limit soon because it's ext3. and that folder is expected to have +100k ...
5
votes
1answer
570 views

What exactly does the automated ext3 root file system check?

Recently we encountered a problem (bad blocks) with an ext3 formatted compact flash card running an embedded Linux system. On startup, the root file system check was started, but it seemed to hang ...
4
votes
3answers
22k views

Read-only root file system - ext3 error?

I have a problem with ext3 filesystem. It's not writable and I can't remount it. # echo 1 > /file -bash: /file: Read-only file system # mount /dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw) # ...
4
votes
3answers
1k views

lvm+ext3 vs ext3 recovery

I would like to hear from people who have personal experience recovering crashed systems or data from crashed drives using lvm+ext3 and ext3. Which option is harder to recover from backup or to ...
4
votes
2answers
2k views

Are there any invalid characters for an ext3 filename?

Which characters are invalid for an ext3 filename? I imagine that at least / is an invalid character and probably \0. Is there an official list somewhere? I'm not exactly sure where to look for ...
4
votes
3answers
6k views

How to fsck.ext3 a TrueCrypt Volume?

I have a truecrypt file that contains an ext3 file system. Not sure exactly how to word this, but is there a way I can mount the truecrypt volume without actually mounting the filesystem within it so ...
4
votes
1answer
645 views

rsync copies unmodified files between different file systems

I try to synchronize files between two machines using rsync, but it seems to copy all the files regardless file modification time. Two consecutive call of the command produces the same results, so it ...
4
votes
1answer
1k views

Folder size is greater than 4K on ext3

Lets say we have a default formatted ext3 filesystem, I run under the assumption that folders take 4K of space on the disk. But, what does it mean when a folder is bigger than 4K? Here is a pic of ...
4
votes
2answers
2k views

Major issues with fsck of 10TB ext3 RAID 6 (memory allocation failed, etc.)

I recently added a 7th 2TB drive to a linux md software RAID 6 setup. After md finished reshaping the array from 6 to 7 drives (from 8 to 10TB), I was still able to mount the file system without ...