0
votes
2answers
150 views

FS for many small files, mostly reads?

I need a direction since all the blogs/benchs seems to contradict. Goal: Having a lot of small files on FS in a directory tree fashion similar to this AB/CD/EF... Two size groups : G1 : 10-20 kB G2 ...
11
votes
1answer
347 views

ext4 listing of files very slow in one specific directory that contained lots of files before

Background I had a small logrotate misshap... Logrotate would rotate the archived logs by misstake causing a quadratic growth of files in my /var/log/. And by the time I caught wind that something ...
3
votes
1answer
157 views

Ext4 cache options on a virtual machine

I'm trying to speed up a standup of virtual machines used for development / automated test environments and wanted to verify some assumptions about disk writes caching. I'm using ext4 for the root ...
1
vote
1answer
138 views

Which directory hierarchy will be the best/fastest?

I have a pretty big directory with many cache files which I want to reorganise for max performance (access times). 2x 2TB SATA III drives, software RAID 1 (mirroring) OS: Ubuntu 12.04 LTS ...
1
vote
2answers
404 views

Are ext4 RAID5 tuning options useful under LVM?

I'm setting up a system with a system with a mdadm RAID5 which is the sole PV for a VG which hosts 4 LVs. When I make the filesystem, would the mkfs.ext4 -E option be useful? Or is its effect not ...
2
votes
1answer
77 views

Why would disk reads be heavier than writes with a simple java app that creates many small files?

I've got a very simple java 7 app that reads from a proprietary file format (Hadoop sequencefile) sitting on disk xvdb and creates millions of 2-20kb files on disk xvdf. ByteBuffer byteBuffer = ...
0
votes
1answer
215 views

file read performance degrades as number of files increases

We're observing poor file read IO results that we'd like to better understand. We can use fio to write 100 files with a sustained aggregate throughput of ~700MB/s. When we switch the test to read ...
1
vote
1answer
196 views

optimizing ext[234] for small file throughput

I have a system that has a high throughput of small files on disk, i.e. a huge number of small files are created, written and deleted within seconds. Are there any reasonable ext2/ext3/ext4 mount ...
5
votes
2answers
1k views

PERC 6/i | ext4 | raid5 | 4 disks - improve write performance

I am running several fileservers using this controller, filesystem and disk setup. All of them are suffering from poor write performance, once the 256MB BBU Write Cache is full i get really high ...
10
votes
10answers
738 views

How does the number of subdirectories impact drive read / write performance on Linux?

I've got an EXT3 formatted drive on a Linux CentOS server. This is a web app data drive and contains a directory for every user account ( there are 25,000 users ). Each folder contains files that ...
0
votes
1answer
266 views

Appropriate Linux (ubuntu 10.04) FS type for rapid FS management many small files and directories [duplicate]

Possible Duplicate: Linux's best filesystem to work with 10000's of files without overloading the system I/O I have an 240gb image store of approximately 1.5 million entries. About ...
4
votes
1answer
2k views

Does increasing the journal size improve performance for ext4 filesystems?

There is an article on linux-mag which says that increasing the size of the journal on ext4 filesystems actually improves filesystem performance for very large partitions. I'm wondering if anyone ...