We built one windows 2012R2 server (it has enough free memory/disk space, high performance of CPU), but it would be frozen for around half hour every 12 hours.
The symptoms:
couldn't access the website hosted in the server
couldn't remote into the server
The findings:
- many EventID=508 (for svchost.eve), 833 (for sqlserver) in the EventView of the server.
One of the EventID=508: svchost (2128) A request to write to the file "C:\Windows\system32\LogFiles\Sum\Svc.log" at offset 4775936 (0x000000000048e000) for 4096 (0x00001000) bytes succeeded, but took an abnormally long time (36 seconds) to be serviced by the OS. This problem is likely due to faulty hardware. Please contact your hardware vendor for further assistance diagnosing the problem.
below is the chart for Disk performance:
you will see % IDLE Time is less than 40%, Queue Length reaches 100 sometimes. Even it seems the data collector stop working between 8:37AM and 8:50AM.
It seems the bottleneck is Disk I/O, and it caused the server was frozen. But I have no idea how to further investigate.
My questions:
is % IDEL Time < 40% very bad? what about Queue length reaches 100?
what may cause the data collector stop working?
If the root cause is faulty hardware, how the server is working fine during most time of one day?