Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I'm running 2.6.32-5-xen-amd64 on a domU with Debian stable and 6 vcpus. Without changing anything in the architecture 3 days ago it started throwing kernel panics on high load. I've researched online and found a couple of mailing list posts, but none that would provide a solution.

Here is the log:

[ 58.806593] alignment check: 0000 [#1] SMP

[ 58.806610] last sysfs file: /sys/module/x_tables/initstate

[ 58.806615] CPU 4

[ 58.806620] Modules linked in: xt_tcpudp iptable_filter ip_tables x_tables fuse nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr evdev ext3 jbd mbcache dm_mod xen_netfront xen_blkfront

[ 58.806668] Pid: 1561, comm: node Not tainted 2.6.32-5-xen-amd64 #1

[ 58.806673] RIP: e030:[] [] eth_type_trans+0x3d/0xae [ 58.806690] RSP: e02b:ffff8801cd07f988 EFLAGS: 00050246

[ 58.806695] RAX: ffff8801fb29ecfc RBX: ffff8801fbb44ce8 RCX: ffff8801fb29ecee

[ 58.806702] RDX: 0000000000000042 RSI: 000000000000000e RDI: ffff8801fbb44ce8

[ 58.806709] RBP: ffff8801ff056000 R08: 0000000000000002 R09: ffffffff814eeab0

[ 58.806715] R10: 000000000000000e R11: ffffffff8125fbaf R12: ffff8801fd6a5b00

[ 58.806721] R13: ffff8801ff056000 R14: ffff8801ff150b00 R15: ffffffff81350270

[ 58.806732] FS: 00007f7e5b149700(0000) GS:ffff88000bb45000(0000) knlGS:0000000000000000

[ 58.806740] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b

[ 58.806745] CR2: 00007f7e59f9ffd0 CR3: 0000000001001000 CR4: 0000000000002660

[ 58.806752] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000

[ 58.806758] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

[ 58.806765] Process node (pid: 1561, threadinfo ffff8801cd07e000, task ffff8801fdc0c6a0)

[ 58.806772] Stack:

[ 58.806775] 0000000000000002 ffff8801ff056000 ffff8801fbb44ce8 ffffffff812398d0

[ 58.806785] <0> 0000000000000004 ffff8801fbb44ce8 ffff8801fd6a5b00 ffffffff8125f9e4

[ 58.806797] <0> ffffffff81285100 0000000000000004 ffff8801ff150b00 ffff8801fd6a5b00

[ 58.806810] Call Trace:

[ 58.806818] [] ? loopback_xmit+0x36/0x7a

[ 58.806827] [] ? dev_hard_start_xmit+0x211/0x2db

[ 58.806837] [] ? dst_output+0x0/0xb

[ 58.806843] [] ? dev_queue_xmit+0x2dd/0x38d

[ 58.806850] [] ? ip_queue_xmit+0x311/0x386

[ 58.806861] [] ? check_events+0x12/0x20

[ 58.806869] [] ? tcp_transmit_skb+0x648/0x687

[ 58.806876] [] ? check_events+0x12/0x20

[ 58.806887] [] ? d_kill+0x58/0x61

[ 58.806894] [] ? tcp_write_xmit+0x874/0x96c

[ 58.806902] [] ? __tcp_push_pending_frames+0x22/0x53

[ 58.806910] [] ? tcp_close+0x176/0x3d0

[ 58.806916] [] ? d_kill+0x58/0x61

[ 58.806924] [] ? inet_release+0x4e/0x54

[ 58.806935] [] ? sock_release+0x19/0x66

[ 58.806942] [] ? sock_close+0x22/0x26

[ 58.806951] [] ? __fput+0x100/0x1af

[ 58.806958] [] ? filp_close+0x5b/0x62

[ 58.806967] [] ? put_files_struct+0x64/0xc1

[ 58.806974] [] ? do_exit+0x22e/0x6c6

[ 58.806981] [] ? do_exit+0x236/0x6c6

[ 58.806988] [] ? do_group_exit+0x76/0x9d

[ 58.806997] [] ? get_signal_to_deliver+0x310/0x339

[ 58.807005] [] ? do_notify_resume+0x87/0x73f

[ 58.807012] [] ? check_events+0x12/0x20

[ 58.807020] [] ? xen_restore_fl_direct_end+0x0/0x1

[ 58.807031] [] ? _spin_unlock_irqrestore+0xd/0xe

[ 58.807038] [] ? kprobe_flush_task+0x9f/0xac

[ 58.807048] [] ? finish_task_switch+0x96/0xaf

[ 58.807056] [] ? int_signal+0x12/0x17

[ 58.807061] Code: 87 d8 00 00 00 2b 87 d0 00 00 00 be 0e 00 00 00 89 87 c4 00 00 00 e8 68 48 fe ff 8b 8b c4 00 00 00 48 03 8b d0 00 00 00 f6 01 01 <48> 8b 11 74 20 48 33 95 40 02 00 00 8a 43 7d 48 c1 e2 10 75 08

[ 58.807143] RIP [] eth_type_trans+0x3d/0xae

[ 58.807151] RSP

[ 58.807158] ---[ end trace e0ab4c430984e308 ]---

[ 58.807162] Kernel panic - not syncing: Fatal exception in interrupt

[ 58.807169] Pid: 1561, comm: node Tainted: G D 2.6.32-5-xen-amd64 #1

[ 58.807175] Call Trace:

[ 58.807181] [] ? panic+0x86/0x143

[ 58.807188] [] ? xen_restore_fl_direct_end+0x0/0x1

[ 58.807197] [] ? dummycon_dummy+0x0/0x3

[ 58.807204] [] ? xen_force_evtchn_callback+0x9/0xa

[ 58.807211] [] ? check_events+0x12/0x20

[ 58.807217] [] ? dummycon_dummy+0x0/0x3

[ 58.807225] [] ? oops_end+0xa7/0xb4

[ 58.807233] [] ? do_alignment_check+0x88/0x92

[ 58.807240] [] ? alignment_check+0x25/0x30

[ 58.807247] [] ? dev_queue_xmit+0x0/0x38d

[ 58.807254] [] ? eth_type_trans+0x3d/0xae

[ 58.807261] [] ? eth_type_trans+0x2d/0xae

[ 58.807267] [] ? loopback_xmit+0x36/0x7a

[ 58.807274] [] ? dev_hard_start_xmit+0x211/0x2db

[ 58.807281] [] ? dst_output+0x0/0xb

[ 58.807287] [] ? dev_queue_xmit+0x2dd/0x38d

[ 58.807294] [] ? ip_queue_xmit+0x311/0x386

[ 58.807301] [] ? check_events+0x12/0x20

[ 58.807308] [] ? tcp_transmit_skb+0x648/0x687

[ 58.807315] [] ? check_events+0x12/0x20

[ 58.807322] [] ? d_kill+0x58/0x61

[ 58.807329] [] ? tcp_write_xmit+0x874/0x96c

[ 58.807336] [] ? __tcp_push_pending_frames+0x22/0x53

[ 58.807343] [] ? tcp_close+0x176/0x3d0

[ 58.807350] [] ? d_kill+0x58/0x61

[ 58.807356] [] ? inet_release+0x4e/0x54

[ 58.807363] [] ? sock_release+0x19/0x66

[ 58.807370] [] ? sock_close+0x22/0x26

[ 58.807376] [] ? __fput+0x100/0x1af

[ 58.807382] [] ? filp_close+0x5b/0x62

[ 58.807389] [] ? put_files_struct+0x64/0xc1

[ 58.807396] [] ? do_exit+0x22e/0x6c6

[ 58.807402] [] ? do_exit+0x236/0x6c6

[ 58.807409] [] ? do_group_exit+0x76/0x9d

[ 58.807415] [] ? get_signal_to_deliver+0x310/0x339

[ 58.807422] [] ? do_notify_resume+0x87/0x73f

[ 58.807429] [] ? check_events+0x12/0x20

[ 58.807436] [] ? xen_restore_fl_direct_end+0x0/0x1

[ 58.807443] [] ? _spin_unlock_irqrestore+0xd/0xe

[ 58.807450] [] ? kprobe_flush_task+0x9f/0xac

[ 58.807457] [] ? finish_task_switch+0x96/0xaf

[ 58.807463] [] ? int_signal+0x12/0x17

share|improve this question
    
Have you run any hardware diagnostics on the system? –  Kyle Smith Feb 19 '12 at 5:04
    
Why are you running -xen kernel in DomU? –  SaveTheRbtz Feb 19 '12 at 13:29
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.