Details: We have 6 servers in a web farm behind an F5. There are approximately 25 AppPools on each of these servers.
On servers 1 - 5 the apppools are consuming approx 500MB Private Bytes, and 5GB Virtual Bytes. On server 6 the apppools are consuming approx 800MB Private Bytes, and 8GB Virtual Bytes.
I can not seem to figure out why we have this difference. The code is the exact same on each box. We replicate the apphost.config between the boxes, so the Appplication Configs are identical. I've used msdeploy to confirm that all of the servers have 100% the same IIS configuration. Same hardware. Boxes are round robin load balanced, and I've confirmed that the servers are taking the same requests per second.
The only difference seems to be that this box consumes more RAM, and in turn ends up using a lot more CPU. During Black Friday we observed the CPU on server 6 spiking to 100% and noticed that the % Memory Commit was also near 100%, while the rest of the farm was at closer to 50% utilization. Pulling the 6th server from the load balancer dropped CPU/Memory on the 6th server back to normal, and did not cause a noticeable strain on the other servers.
My question is: Why is this one server using more RAM, and what could be the cause of this? The load, code, hardware, configuration is all the same.
Is there another tool I can use to compare the 2 servers?