How can I measure complex I/O activity to develop realistic benchmarking? [closed]

Question

I need to retrieve a few metric from my service server to benchmark another stroage solution. There are various options are provied by benchmark program(I choosed FIO,http://freecode.com/projects/fio). I could easily set up io pattern with it. But I couldn’t know how can i retrive real service’s metric to set up benchmark varible as realistic as possible.

for exmaple, i need to setup,

• random/sequential read/write ratio file size and distribution of each
• file size (if i could possible, random/sequential read/write ratio for each size)
• iodepth
• random access’s revisitaion ratio(might affect random access performance)

I’m currently testing ceph(http://ceph.com/), At least above metrics seems significant impact for those kind of storage from my study. How can i retrieve those value?

collectcl(http://collectl.sourceforge.net/) seemed promssing. But couldn’t figure out any further than read/write ratio. I couldn’f figure out except those thing. I really like to know how other people decide those benchmark variables.

Thanks in advance.

Answer 1

You can use blktrace to record real system storage activity and profile an existing workload. That can be captured to file.

The trace can then be replayed.

Another interesting possibility could be the use of the new sysdig utility to try to analyze what's going on under representative workloads.

In addition, an answer here shows an interesting approach using System Tap:
Linux utility to record IO statistics (random/sequential, block sizes, read/write ratio)