Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I have 2 machine. both the machine I have kernal 2.6.26. Both machines are getting more then 300 load averages even cpu idle time is 80%-90%. In the wa column also very less.

The followings are top command headers of different time.

top - 12:02:27 up 144 days, 14:07,  0 users,  load average: 208.28, 123.16, 95.3
Tasks: 630 total, 162 running, 466 sleeping,   0 stopped,   2 zombie
Cpu(s):  4.2%us,  1.0%sy,  0.2%ni, 93.9%id,  0.7%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   3108296k total,  2988684k used,   119612k free,     1528k buffers
Swap:  5855684k total,  1741440k used,  4114244k free,    53656k cached

top - 12:23:22 up 144 days, 14:27,  0 users,  load average: 195.48, 114.63, 102.
Tasks: 801 total,   1 running, 769 sleeping,   0 stopped,  31 zombie
Cpu(s):  4.2%us,  1.0%sy,  0.2%ni, 93.9%id,  0.7%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   3108296k total,  2956952k used,   151344k free,      856k buffers
Swap:  5855684k total,  1335884k used,  4519800k free,    24320k cached

top - 12:34:55 up 144 days, 14:39,  0 users,  load average: 199.15, 135.33, 112.
Tasks: 663 total,   2 running, 622 sleeping,   0 stopped,  39 zombie
Cpu(s):  4.2%us,  1.0%sy,  0.2%ni, 93.9%id,  0.7%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   3108296k total,  2980572k used,   127724k free,     1936k buffers
Swap:  5855684k total,  1297900k used,  4557784k free,    25420k cached

top - 13:41:50 up 144 days, 15:46,  0 users,  load average: 203.66, 153.91, 119.
Tasks: 976 total,   2 running, 947 sleeping,   0 stopped,  27 zombie
Cpu(s):  4.2%us,  1.0%sy,  0.2%ni, 93.8%id,  0.8%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   3108296k total,  2568824k used,   539472k free,     1380k buffers
Swap:  5855684k total,  2393244k used,  3462440k free,    23160k cached

top - 13:42:58 up 144 days, 15:47,  0 users,  load average: 278.63, 189.22, 134.
Tasks: 699 total,   9 running, 665 sleeping,   0 stopped,  25 zombie
Cpu(s):  4.2%us,  1.0%sy,  0.2%ni, 93.8%id,  0.8%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   3108296k total,  2969516k used,   138780k free,     1472k buffers
Swap:  5855684k total,  1970916k used,  3884768k free,    26524k cached

In the above information I suspect that load average cause might be due to insufficient memory. Please confirm whether it is really insufficient memory or any other problem?

Because I confused to find out the route cause of this problem.

CPU Information:

cpu cores   : 4
apicid      : 0
initial apicid  : 0
fdiv_bug    : no
hlt_bug     : no
f00f_bug    : no
coma_bug    : no
fpu     : yes
fpu_exception   : yes
cpuid level : 13
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm
bogomips    : 4658.69
clflush size    : 64
power management:

processor   : 1
vendor_id   : GenuineIntel
cpu family  : 6
model       : 23
model name  : Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
stepping    : 10
cpu MHz     : 1992.000
cache size  : 6144 KB
physical id : 0
siblings    : 4
core id     : 1
cpu cores   : 4
apicid      : 1
initial apicid  : 1
fdiv_bug    : no
hlt_bug     : no
f00f_bug    : no
coma_bug    : no
fpu     : yes
fpu_exception   : yes
cpuid level : 13
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm
bogomips    : 4655.00
clflush size    : 64
power management:

processor   : 2
vendor_id   : GenuineIntel
cpu family  : 6
model       : 23
model name  : Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
stepping    : 10
cpu MHz     : 1992.000
cache size  : 6144 KB
physical id : 0
siblings    : 4
core id     : 2
cpu cores   : 4
apicid      : 2
initial apicid  : 2
fdiv_bug    : no
hlt_bug     : no
f00f_bug    : no
coma_bug    : no
fpu     : yes
fpu_exception   : yes
cpuid level : 13
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm
bogomips    : 4655.00
clflush size    : 64
power management:

processor   : 3
vendor_id   : GenuineIntel
cpu family  : 6
model       : 23
model name  : Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz
stepping    : 10
cpu MHz     : 1992.000
cache size  : 6144 KB
physical id : 0
siblings    : 4
core id     : 3
cpu cores   : 4
apicid      : 3
initial apicid  : 3
fdiv_bug    : no
hlt_bug     : no
f00f_bug    : no
coma_bug    : no
fpu     : yes
fpu_exception   : yes
cpuid level : 13
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm
bogomips    : 4654.99
clflush size    : 64
power management:

Memory Details:

 free -og

 total       used       free     shared    buffers     cached
   Mem:             2          1          1          0          0          0
   Swap:            5          0          5
share|improve this question
    
Can you paste the output of "vmstat 2 3". It could be a swap problem, but i just want to see how much pages are swapped in a is –  morlix Dec 5 '12 at 11:14
1  
Thanks for your input. Unfortunately I am not having this log now. Because this problem happened day before yesterday. –  muruga Dec 5 '12 at 11:19
    
Next time, when you are in 'top' press '1' (one) to see usage for each core. The default is an average so if you have for example 4 cores and see 25% IO wait usage it could mean one core has 100% IO wait. –  Patryk Sidzina Dec 5 '12 at 12:01
    
I would like to mention that high disk IO can also contribute to a high cpu load. It's possible that you had processes waiting thats why your blocked processes queue started queueing up, causing the high load average. This article explains it very nicely, blog.scoutapp.com/articles/2009/07/31/… –  Danie Dec 5 '12 at 12:01
    
sorry Danie , I am not able to understand what your are coming to say, Explain me little bit clearly (Particularly blocked processes) –  muruga Dec 5 '12 at 12:10

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.