2

I'm in the process of attempting to benchmark a multithreaded application on my new HP Proliant Server which has an 2x Opteron 6272 and 64gb of ram.

When I run the application on a desktop machine (a range of i7s and a Xeon X5675 processors) the application will cause all cores to hit a near 100% utilization.

When I run the application on my server, no matter how many threads I run, the total cpu utilization of the application hovers around 20-25%. That is if I'm running with 32 threads, all 32 cores will hang at around 20%, if I run 16 threads they'll hang around 40%, and so on.

  1. At first I suspected this had to do with the operating system, so I installed Windows 7 on the server so that the desktops and the server had the same OS.
  2. Then I suspected it was the hardware, I changed the power management in the bios to High Performance. Even though this did increase the benchmark time, the same 20% utilization problem persists.
  3. I can get all 32 cores at 100% using the y-cruncher benchmark. My custom benchmark is written in .NET, could this possibly have anything to do with it?

I'm perplexed by this problem. Anyone have an idea of what could cause this?

6
  • What does the application do? Are you sure it's CPU limited? Apr 21, 2012 at 1:35
  • @DavidSchwartz, the application runs a set of advanced satellite access calculations. I'm stuck using 3rd party libraries, so I haven't entirely ruled out something being screwy with that code, I'm chasing that possibility down too. As I mentioned in the post though, the fact I'm able to get CPU utilization up to 100% on a machine with 2x Xeon X5675s (24 cores total) makes me feel like the 3rd party libraries are doing their multithreading correctly.
    – vpiTriumph
    Apr 21, 2012 at 6:24
  • 1
    @vpiTriumph what David meant was: did you check that some other resource (I/O seems likely) is not bottlenecking your threads?
    – the-wabbit
    Apr 21, 2012 at 7:45
  • I have not @syneticon-dj is there a tool you would recommend for doing that?
    – vpiTriumph
    Apr 21, 2012 at 17:37
  • 2
    Perfmon. Take a look at the most interesting relevant counter values in the Windows docs. As a rule of thumb, if the average queue length exceeds the number of disks in your storage subsystem, you are seeing a storage bottleneck. If you see any significant amount of idle time, you probably are not.
    – the-wabbit
    Apr 22, 2012 at 14:12

1 Answer 1

4
+50

If your app is processing a large amount of data, try following the data's path - if the input data is fed from the network, check for possible latencies, bandwidth limitations or transmission errors. You already checked disk I/O which otherwise would be a likely candidate for a bottleneck.

Last but not least, since it is a highly multithreaded .NET application, you should make sure that server garbage collection is used, otherwise you might see weird load characteristics as described in this post from stack overflow.

2
  • A+ lead on the server garbage collection. Setting that correctly has my CPU usage up in the high 90s. I HUGELY appreciate the help.
    – vpiTriumph
    Apr 23, 2012 at 20:06
  • @vpiTriumph you are welcome, glad it worked.
    – the-wabbit
    Apr 24, 2012 at 4:27

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .