0
votes
1answer
27 views

Fastest way to remove numerous big files

I have a directory with integration tests temporary files, which has the following structure: TestTemp --- Test01 (~1.5TB) --- Subdirectory01 (~100GB) -- Destination JSON (1-100MB) ...
2
votes
3answers
24 views

How can I modify the wtime of ext filesystem

How can I modify the superblock of an ext filesystem so that I can set the field wtime (Last write time)? I've tried with debugfs: debugfs 1.42.9 (4-Feb-2014) debugfs: open /dev/sdd2 -w debugfs: ...
3
votes
1answer
113 views

could fsck -Af -M cause corrupt filesystem?

Last night my server encounter "Read-only file system" error. So then I ran "fsck -Af -M" to trying to repair but no use, these are output: fsck 1.39 (29-May-2006) e2fsck 1.39 (29-May-2006) /: ...
0
votes
2answers
74 views

Program complains not enough disk space even if the disk space exists

I have an EXT3 partition mounted in ordered data mode. If a power failure occurs when a program is creating files on that partition, I see that space usage reported is normal and I don't see any ...
4
votes
1answer
334 views

“No space left on device” error when writing certain session filenames

I have some filenames (session files) that can't be written ("No space left on device"). Other filenames (same directory) are fine. Disk is not full. The filesystem is ext3 PHP is giving an error ...
-1
votes
1answer
324 views

Impossible to read / delete some files

How can I fix a message like this (read after a dmesg command)? EXT4-fs error (device hdb1): ext4_lookup: deleted inode referenced: 119197 EXT4-fs error (device hdb1): ext4_free_inode: bit already ...
0
votes
1answer
70 views

Where do ext3 inode / meta-data reside?

Just a quick question about ext3: Are inodes stored in the same area as file data, or are there separate regions on the disk reserved exclusively for meta-data and others reserved exclusively for ...
0
votes
1answer
99 views

simple Linux alternative to Windows extpart to extend basic system disk without downtime?

On Windows there is Dell's extpart which allows one to extend a basic system disk (NTFS) of a running system without downtime. It looks like this: C:\>extpart.exe ExtPart - Utility to extend ...
4
votes
1answer
586 views

rsync copies unmodified files between different file systems

I try to synchronize files between two machines using rsync, but it seems to copy all the files regardless file modification time. Two consecutive call of the command produces the same results, so it ...
-3
votes
2answers
648 views

Copy past speed very slow for a large number of files on Windows

I've run the following test I've created a folder containing 15'000 files of 400 bytes using this batch : @ECHO off SET times=15000 FOR /L %%i IN (1,1,%times%) DO ( fsutil file createnew ...
9
votes
2answers
1k views

Is post-sudden-power-loss filesystem corruption on an SSD drive's ext3 partition “expected behavior”?

My company makes an embedded Debian Linux device that boots from an ext3 partition on an internal SSD drive. Because the device is an embedded "black box", it is usually shut down the rude way, by ...
3
votes
3answers
924 views

Unable to list contents/remove directory (linux ext3)

System is CentOS5 x86_64, completely up to date. I've got a folder that can't be listed (ls just hangs, eating memory until it is killed). The directory size is nearly 500k: root@server ...
0
votes
1answer
948 views

Solaris support for ext4/ext3/btrfs

Does anyone know if Solaris 11 (Sparc version) supports mounting ext3/ext4 or even better Btrfs volumes ? Most of the topics I find on the web are quite outdated (2006/2007) and reference old ...
0
votes
2answers
899 views

Message: mkdir() [function.mkdir]: Too many links

We run a web application as a production. Some days ago I discovered the error signed in subject of this theme. I know what's the problem, but want to ask, what is right way for resolve this? Yes, we ...
3
votes
3answers
1k views

Journaled filesystems and power failure

I heard that even a journaled filesystems such as EXT3/EXT4 might corrupted during power failure, e.g. from wikipedia [1]: In the event of a system crash or power failure, such file systems are ...
2
votes
1answer
720 views

Relatime vs noatime for flash drives

I am running a web server off of a SheevaPlug, and the OS and system are stored on an SD card with an ext3 file system. I know that atime is a major source of writes that wear out flash memory. ...
-2
votes
2answers
300 views

How can I “trick” an ext3 directory to store more than 32000 sub dirs

The easy answers are 1.) move to ext4 and/or 2.) "shard" the directory somehow - by placing them in sub folders either numbered or lettered. These changes won't be easy to make though so I'm looking ...
4
votes
3answers
3k views

CentOS disable filesystem check: superblock last mount time is in the future

I'm persistently getting the "Superblock last mount time is in the future" error when booting CentOS 6. I've seen other questions which ask how to resolve this error, but I know exactly why it's ...
-1
votes
2answers
565 views

Filesystem check on ext3, debian

How can I perform a filesystem check on ext3 partition on linux? I am looking for a solution that check every file on the filesystem that is it accessible. UPDATE: I would run it on a server without ...
0
votes
3answers
610 views

How many subdirectories does the XFS filesystem support within a given directory?

EXT3 supports 32,000 subdirectories. EXT4 supports 64,000... I've read about people having millions of subdirectories on the XFS filesystem, but can't find an exact value referenced anywhere. How ...
10
votes
10answers
779 views

How does the number of subdirectories impact drive read / write performance on Linux?

I've got an EXT3 formatted drive on a Linux CentOS server. This is a web app data drive and contains a directory for every user account ( there are 25,000 users ). Each folder contains files that ...
2
votes
2answers
103 views

What is the best structure to save incremental subfolders?

I have 3 different folders containing particular information about sales orders. Everything was working fine but a few days ago I started having an issue about the amount of subdirectories in each of ...
1
vote
1answer
978 views

EXT3 vs EXT4 vs XFS

Recently I read a lot about "new" file systems. I checked some benchmarks that show MySQL working faster on EXT4 or XFS (and some other FS). I also "found" that XFS and EXT4 are included in CentOS ...
2
votes
1answer
140 views

double mount check with ext3

I have two nodes connected to a SAN, and I want to be able to mount an ext3 partition on node B when node A goes down. I know I could use a shared filesystem, but for simplicity and performance I ...
5
votes
2answers
148 views

Slower/cached Linux file system required

I know it sounds odd but I need a slower or cached filesystem. I have a lot of firewalls that are syslog'ing their data to a pair of Linux VMs which write these files to their 'local' (actually FC ...
2
votes
2answers
3k views

Server Frequently gets Read-Only File System

This server has RAID-1 configured. It get readonly file system everyday. if i reboot it, it gets back with a read-write file system. but after a short while, readonly again... Any idea please? ...
8
votes
1answer
4k views

ext3_dx_add_entry: Directory index full

Background: I'm running lighttpd 1.4.28-1 on CentOS 5.3 to serve the static assets. Signal: recently, it gets slow sometimes. I'm getting the below errors in the kernel log and /var/log/messages: ...
2
votes
2answers
191 views

How many files can I have directly under a directory in ext3?

I have a root directory 'data_0'. Under this directory are about 15,000 directories ('a', 'b', 'c', ... 'aa', 'ab' ...). Under each of theses directories there are thousands of very small files ...
2
votes
1answer
342 views

How to repair a ext3 filesystem other than fsck

Are there any specialized/preferred tools to repair a filesystem for ext3 (or ext4) other than fsck.ext3, fsck.ext4? Thanks
16
votes
2answers
7k views

Production-ready, highly reliable filesystems on Linux: ext4 ext3 XFS or JFS (or ZFS)?

The last real question I've seen on this topic is from about two years ago (is ext4 ready for production usage). In the intervening time, how has ext4 improved? XFS, JFS, and ext3 are the standby ...
4
votes
2answers
480 views

Filesystem performance tuning options for ext3

I have a brand new server w/48G RAM which I am going to use as a DB server. I don't expect problems with disk reads, but I definitely would like to optimize for write intensive load patterns. The ...
23
votes
12answers
4k views

Storing and backing up 10 million files on Linux

I run a website where about 10 million files (book covers) are stored in 3 levels of subdirectories, ranging [0-f]: 0/0/0/ 0/0/1/ ... f/f/f/ This leads to around 2400 files per directory, which is ...
3
votes
1answer
2k views

Disabling journal on a mounted ext3

I'm shredding files on large ext3 file systems (e.g. see this article for how I do this). In order to achieve this I need to mount the ext3 file systems without journaling. To most of them I get by ...
0
votes
7answers
5k views

Good filesystem for 20TB hardware-controlled RAID5 array?

What's the best file system for Ubuntu 10.10 assuming the average filesize is 8-30GB with no more than 1-2 users accessing the array at any given time?
2
votes
1answer
901 views

25TiB for /home from 16TiB, what to do with ext3?

I have recently lvextend my logical volume (where /home is) from 16TiB to 25TiB. However, when I try to run extend2fs on my /dev/vtrak/home, it complains that resize2fs 1.41.12 (17-May-2010) ...
3
votes
1answer
284 views

How to determine how many times an ext3 file system has been mounted

A few months ago I created an ext3 file system on one of my partitions. I received the following message: "mkfs.ext3 /dev/sddx; system will be checked every 20 mounts or 180 days; use tune2fs -c or ...
0
votes
4answers
719 views

directory with 980MB meta data, millions of files, how to delete it? (ext3) [duplicate]

Possible Duplicate: rm on a directory with millions of files Hello, So I'm stuck with this directory: drwxrwxrwx 2 dan users 980M 2010-12-22 18:38 sessions2 The directories contents is ...
7
votes
2answers
13k views

How long should resize2fs take on a 1TB partition?

I've got a new computer at the university and almost set up everything for myself on it when I've noticed that the previous user of the machine used a huge 1TB ext3 partition only. I usually keep ...
1
vote
2answers
341 views

Can I make an ext3 filesystem recognize (and use) the entire partition?

Using gparted and partimage from SysRescCD I recently made a backup image of the partition containing my Ubuntu installation, deleted all partitions except for the original Windows partitions ...
2
votes
4answers
612 views

Huge directory, not files inside, but directory itself

I have been trying to delete a directory from a centos server using rm -Rf /root/FFDC for the past 15 hours and am having great difficulty. I can't do a directory listing because it hangs the system ...
2
votes
2answers
2k views

Questions for Ext3/4 Features ( dir_index,filetype) and XFS File system Performance

I am developing an applications which reads huge list of directories and check file types using file command and using ext4 file system. When i look into Ext4 , i see it have two interesting features ...
1
vote
3answers
180 views

Join files effectively on Linux

Is there a better way to join files that have been splitted than just doing a "cat" or "join"? These commands just copy the file streams into a new file on disk. A much better way would be ...
20
votes
9answers
16k views

Maximum number of files in one ext3 directory while still getting acceptable performance?

I have an application writing to an ext3 directory which over time has grown to roughly three million files. Needless to say, reading the file listing of this directory is unbearably slow. I don't ...
1
vote
1answer
1k views

filesystem mounting problem

A DAS box is attached to my linux box using LSI SCSI HBA. Volume is properly detected on the linux box and filesystem is created using mkfs.ext3 /dev/sdc #No partition table I can not mount ...
3
votes
3answers
793 views

Immutable hard links on ext3/4?

In my research on file versioning at the fs level, snapshotting, and related ideas, I took a look at hard-links and exactly what they are and how they behave. Using rsync you can get a pretty slick ...
6
votes
5answers
1k views

How do I get transparent, efficient, file system snapshotting or versioning on ext3/4?

I've long thought about versioning file systems. This is a killer feature and I've looked at Wayback, ext3cow, zfs, fuse solutions, or just cvs/svn/git overlays. I consider ext3cow the model for my ...
0
votes
4answers
363 views

Log file is missing, how can I see that and what happened to it

A process identified by process id 2147 is running, but its logfile is nowhere to be found. The filesystem is ext3 and 100MB of space remains. nothing went wrong in process 2147. An lsof of process ...
7
votes
1answer
2k views

Best practices for choosing fs block size on ext3/4?

I never really pay block size much attention but obviously there can be benefits to choosing something other than the default. I am looking for a good "best practices" paper on choosing block size. ...
1
vote
2answers
840 views

How can I minimise the size of an ext3 partition (and its LVM logical volume)?

I am using LVM on Ubuntu 9.10 (Karmic). I have a single LVM physical volume (and a single volume group). I have an ext3 filesystem inside an LVM logical volume which I no longer use, but for the time ...
1
vote
2answers
816 views

how to mount an ext3 filesystem with a smaller blocksize then device blocksize?

I had an ext3 filesystem on my hard disk at /dev/hdc2 with a small 1024 byte blocksize. Now I recorded the whole filesystem on a DVD like this: dd if=/dev/hdc2 of=/tmp/image.img wodim -dev=/dev/scd0 ...