Debian Bug report logs - #599089
linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0

version graph

Package: linux-2.6; Maintainer for linux-2.6 is Debian Kernel Team <debian-kernel@lists.debian.org>;

Reported by: Jason Kendall <jakendall@gmail.com>

Date: Mon, 4 Oct 2010 15:15:02 UTC

Severity: important

Tags: upstream

Found in version 2.6.32-23

Fixed in version linux-2.6/2.6.32-25

Done: dann frazier <dannf@debian.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Mon, 04 Oct 2010 15:15:04 GMT) Full text and rfc822 format available.

Acknowledgement sent to Jason Kendall <jakendall@gmail.com>:
New Bug report received and forwarded. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Mon, 04 Oct 2010 15:15:05 GMT) Full text and rfc822 format available.

Message #5 received at submit@bugs.debian.org (full text, mbox):

From: Jason Kendall <jakendall@gmail.com>
To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Mon, 04 Oct 2010 11:13:07 -0400
Package: linux-2.6
Version: 2.6.32-23
Severity: grave
Tags: upstream
Justification: renders package unusable


-- Running NFS inside of a DomU when connected to Dom0 causes kernel 
panic within a few minutes. Does not matter which DomU the NFS is 
connected from. Does not happen when connecting to NFS outside of the 
Xen enviroment.

Notes I've made while diagnosing this issue:

1. Able to run multiple Xen DomUs (8 in total)
2. MX1 has a NFS connection to Dom0 (/home) for mail delivery.
3. I can run MX1 without NFS with no issues, No oops or any issues
4. within a few mins of mounting NFS on MX1 Dom0 crashes
5. Clock-sources are a mixture of XEN and TSC (Xen is default, moved 2 
DomUs to TSC as a troubleshooting step (aaa and MX1)
6. Mounted /home on a different DomU as a test..
7. Leaving the NFS mount on a different DomU did not cause Panic, 
however, no traffic happened left it for a few hours and no panic.
8. Started moving files between NFS and local DomU drive and Panic happened.
9. Coping large amounts of files within the DomU (not over NFS) did not 
seem to cause Oops.
10. Created NFS share on desktop which is not part of the Xen server to 
see if it causes a panic (Identifies if this is a Dom0 or DomU issue)
NOTE: Dom0 has /home which the desktop can access perfectly fine.
11. Moving files from Desktop NFS is ok.

Recap:

DomU <-> DomU: Ok
DomU <-> Desktop NFS: OK
DomU <-> Dom0: Oops
Desktop <-> Dom0: OK


-- Package-specific info:
** Version:
Linux version 2.6.32-5-xen-686 (Debian 2.6.32-23) (dannf@debian.org) 
(gcc version 4.3.5 (Debian 4.3.5-3) ) #1 SMP Sat Sep 18 06:00:14 UTC 2010

** Command line:
placeholder root=UUID=6b304f06-c37f-480f-af92-478443531682 ro quiet

** Not tainted

** Kernel log:
[  157.841231] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.841242] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.841253] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.841265] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872702] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872718] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872728] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872738] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872748] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872759] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872769] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872778] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872788] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872798] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872808] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872818] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.872828] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884349] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884372] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884388] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884405] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884420] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884437] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884455] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884471] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884488] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884506] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884521] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884537] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884555] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  157.884570] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  161.642902] blkback: ring-ref 8, event-channel 8, protocol 1 (x86_32-abi)
[  161.935808] blkback: ring-ref 9, event-channel 9, protocol 1 (x86_32-abi)
[  168.717532] vif7.0: no IPv6 routers present
[  172.787784] device vif8.0 entered promiscuous mode
[  172.797787] eth0: port 9(vif8.0) entering forwarding state
[  172.848319] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848343] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848359] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848374] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848388] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848402] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848420] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848437] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848453] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848468] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848482] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848496] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848511] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.848526] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860830] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860843] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860854] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860864] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860874] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860884] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860894] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860904] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860914] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860924] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860934] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860944] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860954] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860963] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.860974] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874077] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874091] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874101] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874111] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874121] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874131] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874141] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874151] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874161] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874170] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874180] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874190] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874200] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874210] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.874220] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.887977] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.887995] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888088] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888119] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888134] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888152] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888171] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888186] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888202] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888222] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888236] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888252] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888270] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888286] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888301] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  172.888321] physdev match: using --physdev-out in the OUTPUT, FORWARD 
and POSTROUTING chains for non-bridged traffic is not supported anymore.
[  177.711666] blkback: ring-ref 8, event-channel 8, protocol 1 (x86_32-abi)
[  178.054806] blkback: ring-ref 9, event-channel 9, protocol 1 (x86_32-abi)
[  181.495854] Switching to clocksource tsc
[  182.880089] vif8.0: no IPv6 routers present

** Model information
not available

** Loaded modules:
Module                  Size  Used by
xt_tcpudp               1743  8
nf_conntrack_ipv4       7597  16
nf_defrag_ipv4           779  1 nf_conntrack_ipv4
xt_state                 927  16
nf_conntrack           38079  2 nf_conntrack_ipv4,xt_state
xt_physdev              1228  32
iptable_filter          1790  1
ip_tables               7690  1 iptable_filter
x_tables                8327  4 xt_tcpudp,xt_state,xt_physdev,ip_tables
bridge                 32999  0
stp                      996  1 bridge
xen_evtchn              3471  9
xenfs                   7248  1
nfsd                  193247  13
exportfs                2618  1 nfsd
nfs                   206894  0
lockd                  49433  2 nfsd,nfs
fscache                24654  1 nfs
nfs_acl                 1695  2 nfsd,nfs
auth_rpcgss            25240  2 nfsd,nfs
sunrpc                134572  14 nfsd,nfs,lockd,nfs_acl,auth_rpcgss
loop                    9761  32
snd_pcm                47402  0
snd_timer              12258  1 snd_pcm
pl2303                 11624  0
dcdbas                  3940  0
snd                    34363  2 snd_pcm,snd_timer
usbserial              21843  1 pl2303
soundcore               3450  1 snd
snd_page_alloc          5109  1 snd_pcm
psmouse                44653  0
pcspkr                  1207  0
serio_raw               2916  0
shpchp                 21264  0
evdev                   5609  2
i2c_piix4               7124  0
pci_hotplug            18065  1 shpchp
i2c_core               12696  1 i2c_piix4
button                  3598  0
processor              31041  0
acpi_processor          3623  1 processor,[permanent]
ext3                   94196  2
jbd                    32161  1 ext3
mbcache                 3762  1 ext3
sr_mod                 10770  0
cdrom                  26487  1 sr_mod
ata_generic             2019  0
sg                     15972  0
sd_mod                 25865  5
crc_t10dif              1012  1 sd_mod
megaraid_mbox          21022  0
pata_serverworks        3969  0
ohci_hcd               17068  0
megaraid_mm             5451  1 megaraid_mbox
libata                116021  2 ata_generic,pata_serverworks
qla1280                16957  0
tg3                    88633  0
floppy                 40931  0
aacraid                51565  3
libphy                 11638  1 tg3
ehci_hcd               28255  0
scsi_mod              101397  7 
sr_mod,sg,sd_mod,megaraid_mbox,libata,qla1280,aacraid
usbcore                98725  5 pl2303,usbserial,ohci_hcd,ehci_hcd
nls_base                4541  1 usbcore
thermal                 9206  0
thermal_sys             9378  2 processor,thermal

** Network interface configuration:

auto lo
iface lo inet loopback

allow-hotplug eth0
iface eth0 inet static
 address 10.0.0.20
 netmask 255.255.255.0
 broadcast 10.0.0.255
 gateway 10.0.0.1
 dns-domain lab.ostlabs.com
 dns-nameservers 10.0.0.1

** Network status:
*** IP interfaces and addresses:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: peth0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq 
state UP qlen 1000
    link/ether 00:06:5b:f7:eb:c3 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::206:5bff:fef7:ebc3/64 scope link
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
    link/ether 00:06:5b:f7:eb:c4 brd ff:ff:ff:ff:ff:ff
4: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state 
UNKNOWN
    link/ether 00:06:5b:f7:eb:c3 brd ff:ff:ff:ff:ff:ff
    inet 10.0.0.20/24 brd 10.0.0.255 scope global eth0
    inet6 fe80::206:5bff:fef7:ebc3/64 scope link
       valid_lft forever preferred_lft forever
5: vif1.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
6: vif2.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
7: vif3.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
8: vif4.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
9: vif5.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
10: vif6.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
11: vif7.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever
12: vif8.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
pfifo_fast state UNKNOWN qlen 32
    link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fcff:ffff:feff:ffff/64 scope link
       valid_lft forever preferred_lft forever

*** Device statistics:
Inter-|   Receive                                                |  Transmit
 face |bytes    packets errs drop fifo frame compressed 
multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:   12990     151    0    0    0     0          0         0    
12990     151    0    0    0     0       0          0
 peth0:33668865   52529    0    0    0     0          0      1400 
40069263   51090    0    0    0     0       0          0
  eth1:       0       0    0    0    0     0          0         
0        0       0    0    0    0     0       0          0
  eth0:32154816   49419    0    0    0     0          0      2082 
38628135   34224    0    0    0     0       0          0
vif1.0:  320314    3264    0    0    0     0          0         0   
742272    6508    0   13    0     0       0          0
vif2.0:  547294    6543    0    0    0     0          0         0  
1059726    7321    0    9    0     0       0          0
vif3.0:  606762    1869    0    0    0     0          0         0   
633826    4139    0   13    0     0       0          0
vif4.0:   67861     381    0    0    0     0          0         0   
336287    2440    0   13    0     0       0          0
vif5.0:  118042    1447    0    0    0     0          0         0   
466361    3261    0   15    0     0       0          0
vif6.0:  346370    2546    0    0    0     0          0         0   
956549    4325    0   16    0     0       0          0
vif7.0:   18773     316    0    0    0     0          0         0   
303830    2198    0   10    0     0       0          0
vif8.0:     804      13    0    0    0     0          0         0   
271472    1921    0   16    0     0       0          0

*** Protocol statistics:
Ip:
    48197 total packets received
    38 with invalid addresses
    0 forwarded
    0 incoming packets discarded
    48009 incoming packets delivered
    34936 requests sent out
    13 dropped because of missing route
Icmp:
    6 ICMP messages received
    0 input ICMP message failed.
    ICMP input histogram:
        destination unreachable: 6
    73 ICMP messages sent
    0 ICMP messages failed
    ICMP output histogram:
        destination unreachable: 73
IcmpMsg:
        InType3: 6
        OutType3: 73
Tcp:
    11 active connections openings
    38 passive connection openings
    6 failed connection attempts
    0 connection resets received
    3 connections established
    47193 segments received
    34001 segments send out
    25 segments retransmited
    0 bad segments received.
    8 resets sent
Udp:
    416 packets received
    67 packets to unknown port received.
    0 packet receive errors
    841 packets sent
UdpLite:
TcpExt:
    3 TCP sockets finished time wait in fast timer
    109 delayed acks sent
    5 delayed acks further delayed because of locked socket
    1 packets directly queued to recvmsg prequeue.
    26117 packet headers predicted
    940 acknowledgments not containing data payload received
    24570 predicted acknowledgments
    2 times recovered from packet loss by selective acknowledgements
    76 TCP data loss events
    TCPLostRetransmit: 4
    25 fast retransmits
    TCPSackShifted: 74
    TCPSackMerged: 135
    TCPSackShiftFallback: 20
IpExt:
    InBcastPkts: 602
    OutBcastPkts: 51
    InOctets: 32108796
    OutOctets: 38224368
    InBcastOctets: 159844
    OutBcastOctets: 7380

*** Device features:
eth0: 0x11823
eth1: 0x9a3
lo: 0x13865
peth0: 0x9a3
vif1.0: 0x10803
vif2.0: 0x10803
vif3.0: 0x10803
vif4.0: 0x10803
vif5.0: 0x10803
vif6.0: 0x10803
vif7.0: 0x10803
vif8.0: 0x10803

** PCI devices:
00:00.0 Host bridge [0600]: Broadcom CMIC-WS Host Bridge (GC-LE chipset) 
[1166:0012] (rev 13)
    Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-

00:00.1 Host bridge [0600]: Broadcom CMIC-WS Host Bridge (GC-LE chipset) 
[1166:0012]
    Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-

00:00.2 Host bridge [0600]: Broadcom CMIC-LE [1166:0000]
    Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-

00:04.0 Unassigned class [ff00]: Dell Embedded Remote Access or ERA/O 
[1028:000c]
    Subsystem: Dell Embedded Remote Access or ERA/O [1028:000c]
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32, Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 11
    Region 0: Memory at feb80000 (32-bit, prefetchable) [size=4K]
    Region 1: I/O ports at ecf8 [size=8]
    Region 2: I/O ports at ece8 [size=8]
    Expansion ROM at fe000000 [disabled] [size=64K]
    Capabilities: <access denied>

00:04.1 Unassigned class [ff00]: Dell Remote Access Card III [1028:0008]
    Subsystem: Dell Remote Access Card III [1028:0008]
    Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Interrupt: pin B routed to IRQ 23
    Region 0: Memory at fe102000 (32-bit, non-prefetchable) [size=4K]
    Region 1: I/O ports at ec80 [size=64]
    Region 2: Memory at feb00000 (32-bit, prefetchable) [size=512K]
    Capabilities: <access denied>
    Kernel driver in use: serial

00:04.2 Unassigned class [ff00]: Dell Embedded Remote Access: BMC/SMIC 
device [1028:000d]
    Subsystem: Dell Embedded Remote Access: BMC/SMIC device [1028:000d]
    Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Interrupt: pin C routed to IRQ 7
    Region 0: I/O ports at ecf4 [size=4]
    Capabilities: <access denied>

00:0e.0 VGA compatible controller [0300]: ATI Technologies Inc Rage XL 
[1002:4752] (rev 27) (prog-if 00 [VGA controller])
    Subsystem: Dell Device [1028:0121]
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop+ ParErr- 
Stepping+ SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32 (2000ns min), Cache Line Size: 64 bytes
    Region 0: Memory at fd000000 (32-bit, non-prefetchable) [size=16M]
    Region 1: I/O ports at e800 [size=256]
    Region 2: Memory at fe101000 (32-bit, non-prefetchable) [size=4K]
    [virtual] Expansion ROM at e8000000 [disabled] [size=128K]
    Capabilities: <access denied>

00:0f.0 Host bridge [0600]: Broadcom CSB5 South Bridge [1166:0201] (rev 93)
    Subsystem: Broadcom CSB5 South Bridge [1166:0201]
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Latency: 32
    Kernel driver in use: piix4_smbus

00:0f.1 IDE interface [0101]: Broadcom CSB5 IDE Controller [1166:0212] 
(rev 93) (prog-if 82 [Master PriP])
    Subsystem: Broadcom CSB5 IDE Controller [1166:0212]
    Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 64
    Region 0: I/O ports at 01f0 [size=8]
    Region 1: I/O ports at 03f4 [size=1]
    Region 2: I/O ports at 0170 [size=8]
    Region 3: I/O ports at 0374 [size=1]
    Region 4: I/O ports at 08b0 [size=16]
    Kernel driver in use: pata_serverworks

00:0f.2 USB Controller [0c03]: Broadcom OSB4/CSB5 OHCI USB Controller 
[1166:0220] (rev 05) (prog-if 10 [OHCI])
    Subsystem: Broadcom OSB4/CSB5 OHCI USB Controller [1166:0220]
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32 (20000ns max)
    Interrupt: pin A routed to IRQ 11
    Region 0: Memory at fe100000 (32-bit, non-prefetchable) [size=4K]
    Kernel driver in use: ohci_hcd

00:0f.3 ISA bridge [0601]: Broadcom CSB5 LPC bridge [1166:0225]
    Subsystem: Broadcom Dell PowerEdge 1650/1750 [1166:0230]
    Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0

00:10.0 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
[1166:0101] (rev 03)
    Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Capabilities: <access denied>

00:10.2 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
[1166:0101] (rev 03)
    Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Capabilities: <access denied>

00:11.0 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
[1166:0101] (rev 05)
    Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Capabilities: <access denied>

00:11.2 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
[1166:0101] (rev 05)
    Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Capabilities: <access denied>

02:06.0 PCI bridge [0604]: Intel Corporation 21154 PCI-to-PCI Bridge 
[8086:b154] (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32
    Bus: primary=02, secondary=03, subordinate=04, sec-latency=32
    I/O behind bridge: 0000d000-0000dfff
    Memory behind bridge: fcd00000-fcffffff
    Prefetchable memory behind bridge: 00000000f0000000-00000000f7ffffff
    Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: <access denied>

03:00.0 PCI bridge [0604]: Intel Corporation 21154 PCI-to-PCI Bridge 
[8086:b154] (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32
    Bus: primary=03, secondary=04, subordinate=04, sec-latency=32
    Memory behind bridge: fcf00000-fcffffff
    Prefetchable memory behind bridge: 00000000f0000000-00000000f7ffffff
    Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: <access denied>

03:01.0 SCSI storage controller [0100]: QLogic Corp. ISP12160 Dual 
Channel Ultra3 SCSI Processor [1077:1216] (rev 06)
    Subsystem: American Megatrends Inc. QLA12160 on AMI MegaRAID 
[101e:8493]
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32 (16000ns min), Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 11
    Region 0: I/O ports at dc00 [size=256]
    Region 1: Memory at fcdff000 (32-bit, non-prefetchable) [size=4K]
    Expansion ROM at fce00000 [disabled] [size=128K]
    Capabilities: <access denied>

04:00.0 RAID bus controller [0104]: American Megatrends Inc. MegaRAID 
[101e:1960] (rev 20)
    Subsystem: Dell PowerEdge RAID Controller 3/DC [1028:0493]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Latency: 32, Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 24
    Region 0: Memory at f0000000 (32-bit, prefetchable) [size=128M]
    Expansion ROM at fcf00000 [disabled] [size=128K]
    Capabilities: <access denied>
    Kernel driver in use: megaraid

05:06.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme 
BCM5701 Gigabit Ethernet [14e4:1645] (rev 15)
    Subsystem: Dell Broadcom BCM5701 1000Base-T [1028:0121]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 64 (16000ns min), Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 28
    Region 0: Memory at eff10000 (64-bit, non-prefetchable) [size=64K]
    Capabilities: <access denied>
    Kernel driver in use: tg3

05:08.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme 
BCM5701 Gigabit Ethernet [14e4:1645] (rev 15)
    Subsystem: Dell Broadcom BCM5701 1000Base-T [1028:0121]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 64 (16000ns min), Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 29
    Region 0: Memory at eff00000 (64-bit, non-prefetchable) [size=64K]
    Capabilities: <access denied>
    Kernel driver in use: tg3

06:08.0 PCI bridge [0604]: Intel Corporation 80303 I/O Processor 
PCI-to-PCI Bridge [8086:0309] (rev 01) (prog-if 00 [Normal decode])
    Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- 
<TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 32, Cache Line Size: 64 bytes
    Bus: primary=06, secondary=07, subordinate=07, sec-latency=32
    Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ <SERR- <PERR-
    BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
        PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
    Capabilities: <access denied>

06:08.1 RAID bus controller [0104]: Dell PowerEdge Expandable RAID 
Controller 3/Di [1028:000a] (rev 01)
    Subsystem: Dell PERC 3/DiB [Boxster] [1028:0121]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- 
<TAbort- <MAbort+ >SERR- <PERR- INTx-
    Latency: 32, Cache Line Size: 64 bytes
    Interrupt: pin A routed to IRQ 30
    Region 0: Memory at e0000000 (32-bit, prefetchable) [size=128M]
    Expansion ROM at efd00000 [disabled] [size=64K]
    Capabilities: <access denied>
    Kernel driver in use: aacraid


** USB devices:
Bus 001 Device 002: ID 067b:aaa0 Prolific Technology, Inc. Prolific Pharos
Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub


-- System Information:
Debian Release: squeeze/sid
  APT prefers testing
  APT policy: (500, 'testing')
Architecture: i386 (i686)

Kernel: Linux 2.6.32-5-xen-686 (SMP w/4 CPU cores)
Locale: LANG=en_CA.UTF-8, LC_CTYPE=en_CA.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages linux-image-2.6.32-5-xen-686 depends on:
ii  debconf [debconf-2.0]         1.5.35     Debian configuration 
management sy
ii  initramfs-tools               0.98.4     tools for generating an 
initramfs
ii  linux-base                    2.6.32-23  Linux image base package
ii  module-init-tools             3.12-1     tools for managing Linux 
kernel mo

Versions of packages linux-image-2.6.32-5-xen-686 recommends:
ii  firmware-linux-free           2.6.32-23  Binary firmware for various 
driver
ii  libc6-xen                     2.11.2-6   Embedded GNU C Library: 
Shared lib

Versions of packages linux-image-2.6.32-5-xen-686 suggests:
pn  grub <none>     (no description available)
pn  linux-doc-2.6.32 <none>     (no description available)

Versions of packages linux-image-2.6.32-5-xen-686 is related to:
pn  firmware-bnx2 <none>     (no description available)
pn  firmware-bnx2x <none>     (no description available)
pn  firmware-ipw2x00 <none>     (no description available)
pn  firmware-ivtv <none>     (no description available)
pn  firmware-iwlwifi <none>     (no description available)
pn  firmware-linux <none>     (no description available)
pn  firmware-linux-nonfree <none>     (no description available)
pn  firmware-qlogic <none>     (no description available)
pn  firmware-ralink <none>     (no description available)
ii  xen-hypervisor-4.0-i386 [xen- 4.0.1-1    The Xen Hypervisor on i386

-- debconf information:
  
linux-image-2.6.32-5-xen-686/postinst/depmod-error-initrd-2.6.32-5-xen-686: 
false
  
linux-image-2.6.32-5-xen-686/postinst/ignoring-do-bootloader-2.6.32-5-xen-686:
  
linux-image-2.6.32-5-xen-686/prerm/removing-running-kernel-2.6.32-5-xen-686: 
true
  linux-image-2.6.32-5-xen-686/postinst/missing-firmware-2.6.32-5-xen-686:

------ netconsole Trace:

Oct  4 09:45:31 10.0.0.20 kernel: [173927.281586] netconsole: local port 
6666
Oct  4 09:45:31 10.0.0.20 kernel: [173927.281599] netconsole: local IP 
10.0.0.20
Oct  4 09:45:31 10.0.0.20 kernel: [173927.281605] netconsole: interface eth0
Oct  4 09:45:31 10.0.0.20 kernel: [173927.281612] netconsole: remote 
port 514
Oct  4 09:45:31 10.0.0.20 kernel: [173927.281619] netconsole: remote IP 
10.0.0.100
Oct  4 09:45:31 10.0.0.20 kernel: [173927.281627] netconsole: remote 
ethernet address 00:1a:70:11:c5:ff
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595807] netconsole: local port 
6666
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595820] netconsole: local IP 
10.0.0.20
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595830] netconsole: interface 
peth0
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595839] netconsole: remote 
port 514
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595848] netconsole: remote IP 
10.0.0.100
Oct  4 09:45:47 10.0.0.20 kernel: [173943.595859] netconsole: remote 
ethernet address 00:1a:70:11:c5:ff
Oct  4 09:45:47 10.0.0.20 kernel: [173943.605629] console [netcon0] enabled
Oct  4 09:45:47 10.0.0.20 kernel: [173943.605636] netconsole: network 
logging started
Oct  4 09:52:29 10.0.0.20 [174345.332640] ------------[ cut here 
]------------
Oct  4 09:52:29 10.0.0.20 [174345.332716] kernel BUG at 
/build/buildd-linux-2.6_2.6.32-23-i386-x1D1UQ/linux-2.6-2.6.32/debian/build/source_i386_xen/drivers/xen/grant-table.c:584! 

Oct  4 09:52:29 10.0.0.20 [174345.332805] invalid opcode: 0000 [#1]
Oct  4 09:52:29 10.0.0.20 SMP
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.332903] last sysfs file: 
/sys/module/configfs/initstate
Oct  4 09:52:29 10.0.0.20 [174345.332952] Modules linked in:
Oct  4 09:52:29 10.0.0.20  netconsole
Oct  4 09:52:29 10.0.0.20  configfs
Oct  4 09:52:29 10.0.0.20  xt_tcpudp
Oct  4 09:52:29 10.0.0.20  nf_conntrack_ipv4
Oct  4 09:52:29 10.0.0.20  nf_defrag_ipv4
Oct  4 09:52:29 10.0.0.20  xt_state
Oct  4 09:52:29 10.0.0.20  nf_conntrack
Oct  4 09:52:29 10.0.0.20  xt_physdev
Oct  4 09:52:29 10.0.0.20  iptable_filter
Oct  4 09:52:29 10.0.0.20  ip_tables
Oct  4 09:52:29 10.0.0.20  x_tables
Oct  4 09:52:29 10.0.0.20  bridge
Oct  4 09:52:29 10.0.0.20  stp
Oct  4 09:52:29 10.0.0.20  xen_evtchn
Oct  4 09:52:29 10.0.0.20  xenfs
Oct  4 09:52:29 10.0.0.20  nfsd
Oct  4 09:52:29 10.0.0.20  exportfs
Oct  4 09:52:29 10.0.0.20  nfs
Oct  4 09:52:29 10.0.0.20  lockd
Oct  4 09:52:29 10.0.0.20  fscache
Oct  4 09:52:29 10.0.0.20  nfs_acl
Oct  4 09:52:29 10.0.0.20  auth_rpcgss
Oct  4 09:52:29 10.0.0.20  sunrpc
Oct  4 09:52:29 10.0.0.20  loop
Oct  4 09:52:29 10.0.0.20  snd_pcm
Oct  4 09:52:29 10.0.0.20  snd_timer
Oct  4 09:52:29 10.0.0.20  snd
Oct  4 09:52:29 10.0.0.20  soundcore
Oct  4 09:52:29 10.0.0.20  psmouse
Oct  4 09:52:29 10.0.0.20  pl2303
Oct  4 09:52:29 10.0.0.20  snd_page_alloc
Oct  4 09:52:29 10.0.0.20  usbserial
Oct  4 09:52:29 10.0.0.20  serio_raw
Oct  4 09:52:29 10.0.0.20  pcspkr
Oct  4 09:52:29 10.0.0.20  shpchp
Oct  4 09:52:29 10.0.0.20  evdev
Oct  4 09:52:29 10.0.0.20  dcdbas
Oct  4 09:52:29 10.0.0.20  pci_hotplug
Oct  4 09:52:29 10.0.0.20  i2c_piix4
Oct  4 09:52:29 10.0.0.20  i2c_core
Oct  4 09:52:29 10.0.0.20  processor
Oct  4 09:52:29 10.0.0.20  acpi_processor
Oct  4 09:52:29 10.0.0.20  button
Oct  4 09:52:29 10.0.0.20  ext3
Oct  4 09:52:29 10.0.0.20  jbd
Oct  4 09:52:29 10.0.0.20  mbcache
Oct  4 09:52:29 10.0.0.20  sg
Oct  4 09:52:29 10.0.0.20  sr_mod
Oct  4 09:52:29 10.0.0.20  cdrom
Oct  4 09:52:29 10.0.0.20  sd_mod
Oct  4 09:52:29 10.0.0.20  crc_t10dif
Oct  4 09:52:29 10.0.0.20  ata_generic
Oct  4 09:52:29 10.0.0.20  ohci_hcd
Oct  4 09:52:29 10.0.0.20  pata_serverworks
Oct  4 09:52:29 10.0.0.20  megaraid_mbox
Oct  4 09:52:29 10.0.0.20  megaraid_mm
Oct  4 09:52:29 10.0.0.20  tg3
Oct  4 09:52:29 10.0.0.20  floppy
Oct  4 09:52:29 10.0.0.20  aacraid
Oct  4 09:52:29 10.0.0.20  libphy
Oct  4 09:52:29 10.0.0.20  qla1280
Oct  4 09:52:29 10.0.0.20  ehci_hcd
Oct  4 09:52:29 10.0.0.20  libata
Oct  4 09:52:29 10.0.0.20  usbcore
Oct  4 09:52:29 10.0.0.20  nls_base
Oct  4 09:52:29 10.0.0.20  thermal
Oct  4 09:52:29 10.0.0.20  scsi_mod
Oct  4 09:52:29 10.0.0.20  thermal_sys
Oct  4 09:52:29 10.0.0.20  [last unloaded: scsi_wait_scan]
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.334427]
Oct  4 09:52:29 10.0.0.20 [174345.334472] Pid: 0, comm: swapper Not 
tainted (2.6.32-5-xen-686 #1) PowerEdge 2650
Oct  4 09:52:29 10.0.0.20 [174345.334549] EIP: 0061:[<c119803b>] EFLAGS: 
00010282 CPU: 1
Oct  4 09:52:29 10.0.0.20 [174345.334622] EIP is at 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:52:29 10.0.0.20 [174345.334674] EAX: ffffffea EBX: ec847d40 
ECX: 00000001 EDX: 00000000
Oct  4 09:52:29 10.0.0.20 [174345.334725] ESI: 00007ff0 EDI: e9976000 
EBP: 18375001 ESP: ec847d10
Oct  4 09:52:29 10.0.0.20 [174345.334777]  DS: 007b ES: 007b FS: 00d8 
GS: 00e0 SS: 0069
Oct  4 09:52:29 10.0.0.20 [174345.334828] Process swapper (pid: 0, 
ti=ec846000 task=ec838880 task.ti=ec846000)
Oct  4 09:52:29 10.0.0.20 [174345.334900] Stack:
Oct  4 09:52:29 10.0.0.20 [174345.334953]  000020d1
Oct  4 09:52:29 10.0.0.20  c2424798
Oct  4 09:52:29 10.0.0.20  000000ba
Oct  4 09:52:29 10.0.0.20  c2eaea20
Oct  4 09:52:29 10.0.0.20  c339fea0
Oct  4 09:52:29 10.0.0.20  c20d1000
Oct  4 09:52:29 10.0.0.20  c20d1000
Oct  4 09:52:29 10.0.0.20  00000000
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.335118] <0>
Oct  4 09:52:29 10.0.0.20  e9975000
Oct  4 09:52:29 10.0.0.20  00000000
Oct  4 09:52:29 10.0.0.20  000000ba
Oct  4 09:52:29 10.0.0.20  117f0000
Oct  4 09:52:29 10.0.0.20  18375001
Oct  4 09:52:29 10.0.0.20  00000000
Oct  4 09:52:29 10.0.0.20  000020d1
Oct  4 09:52:29 10.0.0.20  00000000
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.335327] <0>
Oct  4 09:52:29 10.0.0.20  ed811c70
Oct  4 09:52:29 10.0.0.20  ed811da8
Oct  4 09:52:29 10.0.0.20  ed81161c
Oct  4 09:52:29 10.0.0.20  0006a875
Oct  4 09:52:29 10.0.0.20  c11a49ca
Oct  4 09:52:29 10.0.0.20  117fe518
Oct  4 09:52:29 10.0.0.20  00009e8f
Oct  4 09:52:29 10.0.0.20  117fe518
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.335573] Call Trace:
Oct  4 09:52:29 10.0.0.20 [174345.335625]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:52:29 10.0.0.20 [174345.335682]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:52:29 10.0.0.20 [174345.335740]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:52:29 10.0.0.20 [174345.335795]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:52:29 10.0.0.20 [174345.335852]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:52:29 10.0.0.20 [174345.335908]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:52:29 10.0.0.20 [174345.335963]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336031]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:52:29 10.0.0.20 [174345.336110]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336176]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:52:29 10.0.0.20 [174345.336247]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:52:29 10.0.0.20 [174345.336318]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:52:29 10.0.0.20 [174345.336384]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:52:29 10.0.0.20 [174345.336437]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:52:29 10.0.0.20 [174345.336490]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5
Oct  4 09:52:29 10.0.0.20 [174345.336513] Code:
Oct  4 09:52:29 10.0.0.20 00
Oct  4 09:52:29 10.0.0.20 31
Oct  4 09:52:29 10.0.0.20 d2
Oct  4 09:52:29 10.0.0.20 8b
Oct  4 09:52:29 10.0.0.20 04
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 89
Oct  4 09:52:29 10.0.0.20 6c
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 30
Oct  4 09:52:29 10.0.0.20 8d
Oct  4 09:52:29 10.0.0.20 5c
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 30
Oct  4 09:52:29 10.0.0.20 c7
Oct  4 09:52:29 10.0.0.20 44
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 34
Oct  4 09:52:29 10.0.0.20 00
Oct  4 09:52:29 10.0.0.20 last message repeated 3 times
Oct  4 09:52:29 10.0.0.20 89
Oct  4 09:52:29 10.0.0.20 44
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 38
Oct  4 09:52:29 10.0.0.20 c7
Oct  4 09:52:29 10.0.0.20 44
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 3c
Oct  4 09:52:29 10.0.0.20 00
Oct  4 09:52:29 10.0.0.20 last message repeated 3 times
Oct  4 09:52:29 10.0.0.20 e8
Oct  4 09:52:29 10.0.0.20 e9
Oct  4 09:52:29 10.0.0.20 9f
Oct  4 09:52:29 10.0.0.20 e6
Oct  4 09:52:29 10.0.0.20 ff
Oct  4 09:52:29 10.0.0.20 85
Oct  4 09:52:29 10.0.0.20 c0
Oct  4 09:52:29 10.0.0.20 74
Oct  4 09:52:29 10.0.0.20 04
Oct  4 09:52:29 10.0.0.20 0b
Oct  4 09:52:29 10.0.0.20 eb
Oct  4 09:52:29 10.0.0.20 fe
Oct  4 09:52:29 10.0.0.20 8b
Oct  4 09:52:29 10.0.0.20 54
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 0c
Oct  4 09:52:29 10.0.0.20 8b
Oct  4 09:52:29 10.0.0.20 42
Oct  4 09:52:29 10.0.0.20 10
Oct  4 09:52:29 10.0.0.20 8b
Oct  4 09:52:29 10.0.0.20 54
Oct  4 09:52:29 10.0.0.20 24
Oct  4 09:52:29 10.0.0.20 10
Oct  4 09:52:29 10.0.0.20 89
Oct  4 09:52:29 10.0.0.20 42
Oct  4 09:52:29 10.0.0.20 10
Oct  4 09:52:29 10.0.0.20 0f
Oct  4 09:52:29 10.0.0.20 ba
Oct  4 09:52:29 10.0.0.20 2a
Oct  4 09:52:29 10.0.0.20
Oct  4 09:52:29 10.0.0.20 [174345.336513] EIP: [<c119803b>]
Oct  4 09:52:29 10.0.0.20 gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:52:29 10.0.0.20  SS:ESP 0069:ec847d10
Oct  4 09:52:29 10.0.0.20 [174345.336513] ---[ end trace 
12e6e134d9f4fe6d ]---
Oct  4 09:52:29 10.0.0.20 [174345.336513] Kernel panic - not syncing: 
Fatal exception in interrupt
Oct  4 09:52:29 10.0.0.20 [174345.336513] Pid: 0, comm: swapper Tainted: 
G      D    2.6.32-5-xen-686 #1
Oct  4 09:52:29 10.0.0.20 [174345.336513] Call Trace:
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128c191>] ? panic+0x38/0xe4
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128e799>] ? 
oops_end+0x91/0x9d
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009f21>] ? 
do_invalid_op+0x0/0x75
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009f8d>] ? 
do_invalid_op+0x6c/0x75
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1092fc1>] ? 
__alloc_pages_nodemask+0xf3/0x4e0
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128de8b>] ? 
error_code+0x73/0x78
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5
Oct  4 09:53:33 10.0.0.20 [174410.032507] BUG: soft lockup - CPU#1 stuck 
for 61s! [swapper:0]
Oct  4 09:53:33 10.0.0.20 [174410.032507] Modules linked in:
Oct  4 09:53:33 10.0.0.20  netconsole
Oct  4 09:53:33 10.0.0.20  configfs
Oct  4 09:53:33 10.0.0.20  xt_tcpudp
Oct  4 09:53:33 10.0.0.20  nf_conntrack_ipv4
Oct  4 09:53:33 10.0.0.20  nf_defrag_ipv4
Oct  4 09:53:33 10.0.0.20  xt_state
Oct  4 09:53:33 10.0.0.20  nf_conntrack
Oct  4 09:53:33 10.0.0.20  xt_physdev
Oct  4 09:53:33 10.0.0.20  iptable_filter
Oct  4 09:53:33 10.0.0.20  ip_tables
Oct  4 09:53:33 10.0.0.20  x_tables
Oct  4 09:53:33 10.0.0.20  bridge
Oct  4 09:53:33 10.0.0.20  stp
Oct  4 09:53:33 10.0.0.20  xen_evtchn
Oct  4 09:53:33 10.0.0.20  xenfs
Oct  4 09:53:33 10.0.0.20  nfsd
Oct  4 09:53:33 10.0.0.20  exportfs
Oct  4 09:53:33 10.0.0.20  nfs
Oct  4 09:53:33 10.0.0.20  lockd
Oct  4 09:53:33 10.0.0.20  fscache
Oct  4 09:53:33 10.0.0.20  nfs_acl
Oct  4 09:53:33 10.0.0.20  auth_rpcgss
Oct  4 09:53:33 10.0.0.20  sunrpc
Oct  4 09:53:33 10.0.0.20  loop
Oct  4 09:53:33 10.0.0.20  snd_pcm
Oct  4 09:53:33 10.0.0.20  snd_timer
Oct  4 09:53:33 10.0.0.20  snd
Oct  4 09:53:33 10.0.0.20  soundcore
Oct  4 09:53:33 10.0.0.20  psmouse
Oct  4 09:53:33 10.0.0.20  pl2303
Oct  4 09:53:33 10.0.0.20  snd_page_alloc
Oct  4 09:53:33 10.0.0.20  usbserial
Oct  4 09:53:33 10.0.0.20  serio_raw
Oct  4 09:53:33 10.0.0.20  pcspkr
Oct  4 09:53:33 10.0.0.20  shpchp
Oct  4 09:53:33 10.0.0.20  evdev
Oct  4 09:53:33 10.0.0.20  dcdbas
Oct  4 09:53:33 10.0.0.20  pci_hotplug
Oct  4 09:53:33 10.0.0.20  i2c_piix4
Oct  4 09:53:33 10.0.0.20  i2c_core
Oct  4 09:53:33 10.0.0.20  processor
Oct  4 09:53:33 10.0.0.20  acpi_processor
Oct  4 09:53:33 10.0.0.20  button
Oct  4 09:53:33 10.0.0.20  ext3
Oct  4 09:53:33 10.0.0.20  jbd
Oct  4 09:53:33 10.0.0.20  mbcache
Oct  4 09:53:33 10.0.0.20  sg
Oct  4 09:53:33 10.0.0.20  sr_mod
Oct  4 09:53:33 10.0.0.20  cdrom
Oct  4 09:53:33 10.0.0.20  sd_mod
Oct  4 09:53:33 10.0.0.20  crc_t10dif
Oct  4 09:53:33 10.0.0.20  ata_generic
Oct  4 09:53:33 10.0.0.20  ohci_hcd
Oct  4 09:53:33 10.0.0.20  pata_serverworks
Oct  4 09:53:33 10.0.0.20  megaraid_mbox
Oct  4 09:53:33 10.0.0.20  megaraid_mm
Oct  4 09:53:33 10.0.0.20  tg3
Oct  4 09:53:33 10.0.0.20  floppy
Oct  4 09:53:33 10.0.0.20  aacraid
Oct  4 09:53:33 10.0.0.20  libphy
Oct  4 09:53:33 10.0.0.20  qla1280
Oct  4 09:53:33 10.0.0.20  ehci_hcd
Oct  4 09:53:33 10.0.0.20  libata
Oct  4 09:53:33 10.0.0.20  usbcore
Oct  4 09:53:33 10.0.0.20  nls_base
Oct  4 09:53:33 10.0.0.20  thermal
Oct  4 09:53:33 10.0.0.20  scsi_mod
Oct  4 09:53:33 10.0.0.20  thermal_sys
Oct  4 09:53:33 10.0.0.20  [last unloaded: scsi_wait_scan]
Oct  4 09:53:33 10.0.0.20
Oct  4 09:53:33 10.0.0.20 [174410.032507]
Oct  4 09:53:33 10.0.0.20 [174410.032507] Pid: 0, comm: swapper Tainted: 
G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
Oct  4 09:53:33 10.0.0.20 [174410.032507] EIP: 0061:[<c1059e72>] EFLAGS: 
00000202 CPU: 1
Oct  4 09:53:33 10.0.0.20 [174410.032507] EIP is at 
smp_call_function_many+0xed/0x17c
Oct  4 09:53:33 10.0.0.20 [174410.032507] EAX: c145a6dc EBX: 00000002 
ECX: 00000003 EDX: 03cd9000
Oct  4 09:53:33 10.0.0.20 [174410.032507] ESI: c51336dc EDI: 00000001 
EBP: c13fa2b4 ESP: ec847ba0
Oct  4 09:53:33 10.0.0.20 [174410.032507]  DS: 007b ES: 007b FS: 00d8 
GS: 00e0 SS: 0069
Oct  4 09:53:33 10.0.0.20 [174410.032507] CR0: 8005003b CR2: 094c7808 
CR3: 0a1c5000 CR4: 00000660
Oct  4 09:53:33 10.0.0.20 [174410.032507] DR0: 00000000 DR1: 00000000 
DR2: 00000000 DR3: 00000000
Oct  4 09:53:33 10.0.0.20 [174410.032507] DR6: ffff0ff0 DR7: 00000400
Oct  4 09:53:33 10.0.0.20 [174410.032507] Call Trace:
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1006d5c>] ? 
stop_self+0x0/0x30
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1059f1a>] ? 
smp_call_function+0x19/0x1f
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10036be>] ? 
xen_reboot+0x14/0x28
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1003705>] ? 
xen_panic_event+0xa/0xd
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128f990>] ? 
notifier_call_chain+0x2a/0x47
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128f9c0>] ? 
atomic_notifier_call_chain+0xc/0xf
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128c1af>] ? panic+0x56/0xe4
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128e799>] ? 
oops_end+0x91/0x9d
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009f21>] ? 
do_invalid_op+0x0/0x75
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009f8d>] ? 
do_invalid_op+0x6c/0x75
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1092fc1>] ? 
__alloc_pages_nodemask+0xf3/0x4e0
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128de8b>] ? 
error_code+0x73/0x78
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5
Oct  4 09:54:39 10.0.0.20 [174475.532508] BUG: soft lockup - CPU#1 stuck 
for 61s! [swapper:0]
Oct  4 09:54:39 10.0.0.20 [174475.532508] Modules linked in:
Oct  4 09:54:39 10.0.0.20  netconsole
Oct  4 09:54:39 10.0.0.20  configfs
Oct  4 09:54:39 10.0.0.20  xt_tcpudp
Oct  4 09:54:39 10.0.0.20  nf_conntrack_ipv4
Oct  4 09:54:39 10.0.0.20  nf_defrag_ipv4
Oct  4 09:54:39 10.0.0.20  xt_state
Oct  4 09:54:39 10.0.0.20  nf_conntrack
Oct  4 09:54:39 10.0.0.20  xt_physdev
Oct  4 09:54:39 10.0.0.20  iptable_filter
Oct  4 09:54:39 10.0.0.20  ip_tables
Oct  4 09:54:39 10.0.0.20  x_tables
Oct  4 09:54:39 10.0.0.20  bridge
Oct  4 09:54:39 10.0.0.20  stp
Oct  4 09:54:39 10.0.0.20  xen_evtchn
Oct  4 09:54:39 10.0.0.20  xenfs
Oct  4 09:54:39 10.0.0.20  nfsd
Oct  4 09:54:39 10.0.0.20  exportfs
Oct  4 09:54:39 10.0.0.20  nfs
Oct  4 09:54:39 10.0.0.20  lockd
Oct  4 09:54:39 10.0.0.20  fscache
Oct  4 09:54:39 10.0.0.20  nfs_acl
Oct  4 09:54:39 10.0.0.20  auth_rpcgss
Oct  4 09:54:39 10.0.0.20  sunrpc
Oct  4 09:54:39 10.0.0.20  loop
Oct  4 09:54:39 10.0.0.20  snd_pcm
Oct  4 09:54:39 10.0.0.20  snd_timer
Oct  4 09:54:39 10.0.0.20  snd
Oct  4 09:54:39 10.0.0.20  soundcore
Oct  4 09:54:39 10.0.0.20  psmouse
Oct  4 09:54:39 10.0.0.20  pl2303
Oct  4 09:54:39 10.0.0.20  snd_page_alloc
Oct  4 09:54:39 10.0.0.20  usbserial
Oct  4 09:54:39 10.0.0.20  serio_raw
Oct  4 09:54:39 10.0.0.20  pcspkr
Oct  4 09:54:39 10.0.0.20  shpchp
Oct  4 09:54:39 10.0.0.20  evdev
Oct  4 09:54:39 10.0.0.20  dcdbas
Oct  4 09:54:39 10.0.0.20  pci_hotplug
Oct  4 09:54:39 10.0.0.20  i2c_piix4
Oct  4 09:54:39 10.0.0.20  i2c_core
Oct  4 09:54:39 10.0.0.20  processor
Oct  4 09:54:39 10.0.0.20  acpi_processor
Oct  4 09:54:39 10.0.0.20  button
Oct  4 09:54:39 10.0.0.20  ext3
Oct  4 09:54:39 10.0.0.20  jbd
Oct  4 09:54:39 10.0.0.20  mbcache
Oct  4 09:54:39 10.0.0.20  sg
Oct  4 09:54:39 10.0.0.20  sr_mod
Oct  4 09:54:39 10.0.0.20  cdrom
Oct  4 09:54:39 10.0.0.20  sd_mod
Oct  4 09:54:39 10.0.0.20  crc_t10dif
Oct  4 09:54:39 10.0.0.20  ata_generic
Oct  4 09:54:39 10.0.0.20  ohci_hcd
Oct  4 09:54:39 10.0.0.20  pata_serverworks
Oct  4 09:54:39 10.0.0.20  megaraid_mbox
Oct  4 09:54:39 10.0.0.20  megaraid_mm
Oct  4 09:54:39 10.0.0.20  tg3
Oct  4 09:54:39 10.0.0.20  floppy
Oct  4 09:54:39 10.0.0.20  aacraid
Oct  4 09:54:39 10.0.0.20  libphy
Oct  4 09:54:39 10.0.0.20  qla1280
Oct  4 09:54:39 10.0.0.20  ehci_hcd
Oct  4 09:54:39 10.0.0.20  libata
Oct  4 09:54:39 10.0.0.20  usbcore
Oct  4 09:54:39 10.0.0.20  nls_base
Oct  4 09:54:39 10.0.0.20  thermal
Oct  4 09:54:39 10.0.0.20  scsi_mod
Oct  4 09:54:39 10.0.0.20  thermal_sys
Oct  4 09:54:39 10.0.0.20  [last unloaded: scsi_wait_scan]
Oct  4 09:54:39 10.0.0.20
Oct  4 09:54:39 10.0.0.20 [174475.532508]
Oct  4 09:54:39 10.0.0.20 [174475.532508] Pid: 0, comm: swapper Tainted: 
G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
Oct  4 09:54:39 10.0.0.20 [174475.532508] EIP: 0061:[<c1059e6e>] EFLAGS: 
00000202 CPU: 1
Oct  4 09:54:39 10.0.0.20 [174475.532508] EIP is at 
smp_call_function_many+0xe9/0x17c
Oct  4 09:54:39 10.0.0.20 [174475.532508] EAX: c145a6dc EBX: 00000002 
ECX: 00000003 EDX: 03cd9000
Oct  4 09:54:39 10.0.0.20 [174475.532508] ESI: c51336dc EDI: 00000001 
EBP: c13fa2b4 ESP: ec847ba0
Oct  4 09:54:39 10.0.0.20 [174475.532508]  DS: 007b ES: 007b FS: 00d8 
GS: 00e0 SS: 0069
Oct  4 09:54:39 10.0.0.20 [174475.532508] CR0: 8005003b CR2: 094c7808 
CR3: 0a1c5000 CR4: 00000660
Oct  4 09:54:39 10.0.0.20 [174475.532508] DR0: 00000000 DR1: 00000000 
DR2: 00000000 DR3: 00000000
Oct  4 09:54:39 10.0.0.20 [174475.532508] DR6: ffff0ff0 DR7: 00000400
Oct  4 09:54:39 10.0.0.20 [174475.532508] Call Trace:
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1006d5c>] ? 
stop_self+0x0/0x30
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1059f1a>] ? 
smp_call_function+0x19/0x1f
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10036be>] ? 
xen_reboot+0x14/0x28
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1003705>] ? 
xen_panic_event+0xa/0xd
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128f990>] ? 
notifier_call_chain+0x2a/0x47
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128f9c0>] ? 
atomic_notifier_call_chain+0xc/0xf
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128c1af>] ? panic+0x56/0xe4
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128e799>] ? 
oops_end+0x91/0x9d
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009f21>] ? 
do_invalid_op+0x0/0x75
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009f8d>] ? 
do_invalid_op+0x6c/0x75
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1092fc1>] ? 
__alloc_pages_nodemask+0xf3/0x4e0
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128de8b>] ? 
error_code+0x73/0x78
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5
Oct  4 09:55:44 10.0.0.20 [174541.028507] BUG: soft lockup - CPU#1 stuck 
for 61s! [swapper:0]
Oct  4 09:55:44 10.0.0.20 [174541.028507] Modules linked in:
Oct  4 09:55:44 10.0.0.20  netconsole
Oct  4 09:55:44 10.0.0.20  configfs
Oct  4 09:55:44 10.0.0.20  xt_tcpudp
Oct  4 09:55:44 10.0.0.20  nf_conntrack_ipv4
Oct  4 09:55:44 10.0.0.20  nf_defrag_ipv4
Oct  4 09:55:44 10.0.0.20  xt_state
Oct  4 09:55:44 10.0.0.20  nf_conntrack
Oct  4 09:55:44 10.0.0.20  xt_physdev
Oct  4 09:55:44 10.0.0.20  iptable_filter
Oct  4 09:55:44 10.0.0.20  ip_tables
Oct  4 09:55:44 10.0.0.20  x_tables
Oct  4 09:55:44 10.0.0.20  bridge
Oct  4 09:55:44 10.0.0.20  stp
Oct  4 09:55:44 10.0.0.20  xen_evtchn
Oct  4 09:55:44 10.0.0.20  xenfs
Oct  4 09:55:44 10.0.0.20  nfsd
Oct  4 09:55:44 10.0.0.20  exportfs
Oct  4 09:55:44 10.0.0.20  nfs
Oct  4 09:55:44 10.0.0.20  lockd
Oct  4 09:55:44 10.0.0.20  fscache
Oct  4 09:55:44 10.0.0.20  nfs_acl
Oct  4 09:55:44 10.0.0.20  auth_rpcgss
Oct  4 09:55:44 10.0.0.20  sunrpc
Oct  4 09:55:44 10.0.0.20  loop
Oct  4 09:55:44 10.0.0.20  snd_pcm
Oct  4 09:55:44 10.0.0.20  snd_timer
Oct  4 09:55:44 10.0.0.20  snd
Oct  4 09:55:44 10.0.0.20  soundcore
Oct  4 09:55:44 10.0.0.20  psmouse
Oct  4 09:55:44 10.0.0.20  pl2303
Oct  4 09:55:44 10.0.0.20  snd_page_alloc
Oct  4 09:55:44 10.0.0.20  usbserial
Oct  4 09:55:44 10.0.0.20  serio_raw
Oct  4 09:55:44 10.0.0.20  pcspkr
Oct  4 09:55:44 10.0.0.20  shpchp
Oct  4 09:55:44 10.0.0.20  evdev
Oct  4 09:55:44 10.0.0.20  dcdbas
Oct  4 09:55:44 10.0.0.20  pci_hotplug
Oct  4 09:55:44 10.0.0.20  i2c_piix4
Oct  4 09:55:44 10.0.0.20  i2c_core
Oct  4 09:55:44 10.0.0.20  processor
Oct  4 09:55:44 10.0.0.20  acpi_processor
Oct  4 09:55:44 10.0.0.20  button
Oct  4 09:55:44 10.0.0.20  ext3
Oct  4 09:55:44 10.0.0.20  jbd
Oct  4 09:55:44 10.0.0.20  mbcache
Oct  4 09:55:44 10.0.0.20  sg
Oct  4 09:55:44 10.0.0.20  sr_mod
Oct  4 09:55:44 10.0.0.20  cdrom
Oct  4 09:55:44 10.0.0.20  sd_mod
Oct  4 09:55:44 10.0.0.20  crc_t10dif
Oct  4 09:55:44 10.0.0.20  ata_generic
Oct  4 09:55:44 10.0.0.20  ohci_hcd
Oct  4 09:55:44 10.0.0.20  pata_serverworks
Oct  4 09:55:44 10.0.0.20  megaraid_mbox
Oct  4 09:55:44 10.0.0.20  megaraid_mm
Oct  4 09:55:44 10.0.0.20  tg3
Oct  4 09:55:44 10.0.0.20  floppy
Oct  4 09:55:44 10.0.0.20  aacraid
Oct  4 09:55:44 10.0.0.20  libphy
Oct  4 09:55:44 10.0.0.20  qla1280
Oct  4 09:55:44 10.0.0.20  ehci_hcd
Oct  4 09:55:44 10.0.0.20  libata
Oct  4 09:55:44 10.0.0.20  usbcore
Oct  4 09:55:44 10.0.0.20  nls_base
Oct  4 09:55:44 10.0.0.20  thermal
Oct  4 09:55:44 10.0.0.20  scsi_mod
Oct  4 09:55:44 10.0.0.20  thermal_sys
Oct  4 09:55:44 10.0.0.20  [last unloaded: scsi_wait_scan]
Oct  4 09:55:44 10.0.0.20
Oct  4 09:55:44 10.0.0.20 [174541.028507]
Oct  4 09:55:44 10.0.0.20 [174541.028507] Pid: 0, comm: swapper Tainted: 
G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
Oct  4 09:55:44 10.0.0.20 [174541.028507] EIP: 0061:[<c1059e6e>] EFLAGS: 
00000202 CPU: 1
Oct  4 09:55:44 10.0.0.20 [174541.028507] EIP is at 
smp_call_function_many+0xe9/0x17c
Oct  4 09:55:44 10.0.0.20 [174541.028507] EAX: c145a6dc EBX: 00000002 
ECX: 00000003 EDX: 03cd9000
Oct  4 09:55:44 10.0.0.20 [174541.028507] ESI: c51336dc EDI: 00000001 
EBP: c13fa2b4 ESP: ec847ba0
Oct  4 09:55:44 10.0.0.20 [174541.028507]  DS: 007b ES: 007b FS: 00d8 
GS: 00e0 SS: 0069
Oct  4 09:55:44 10.0.0.20 [174541.028507] CR0: 8005003b CR2: 094c7808 
CR3: 0a1c5000 CR4: 00000660
Oct  4 09:55:44 10.0.0.20 [174541.028507] DR0: 00000000 DR1: 00000000 
DR2: 00000000 DR3: 00000000
Oct  4 09:55:44 10.0.0.20 [174541.028507] DR6: ffff0ff0 DR7: 00000400
Oct  4 09:55:44 10.0.0.20 [174541.028507] Call Trace:
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1006d5c>] ? 
stop_self+0x0/0x30
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1059f1a>] ? 
smp_call_function+0x19/0x1f
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10036be>] ? 
xen_reboot+0x14/0x28
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1003705>] ? 
xen_panic_event+0xa/0xd
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128f990>] ? 
notifier_call_chain+0x2a/0x47
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128f9c0>] ? 
atomic_notifier_call_chain+0xc/0xf
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128c1af>] ? panic+0x56/0xe4
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128e799>] ? 
oops_end+0x91/0x9d
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009f21>] ? 
do_invalid_op+0x0/0x75
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009f8d>] ? 
do_invalid_op+0x6c/0x75
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1092fc1>] ? 
__alloc_pages_nodemask+0xf3/0x4e0
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128de8b>] ? 
error_code+0x73/0x78
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5
Oct  4 09:56:50 10.0.0.20 [174606.528507] BUG: soft lockup - CPU#1 stuck 
for 61s! [swapper:0]
Oct  4 09:56:50 10.0.0.20 [174606.528507] Modules linked in:
Oct  4 09:56:50 10.0.0.20  netconsole
Oct  4 09:56:50 10.0.0.20  configfs
Oct  4 09:56:50 10.0.0.20  xt_tcpudp
Oct  4 09:56:50 10.0.0.20  nf_conntrack_ipv4
Oct  4 09:56:50 10.0.0.20  nf_defrag_ipv4
Oct  4 09:56:50 10.0.0.20  xt_state
Oct  4 09:56:50 10.0.0.20  nf_conntrack
Oct  4 09:56:50 10.0.0.20  xt_physdev
Oct  4 09:56:50 10.0.0.20  iptable_filter
Oct  4 09:56:50 10.0.0.20  ip_tables
Oct  4 09:56:50 10.0.0.20  x_tables
Oct  4 09:56:50 10.0.0.20  bridge
Oct  4 09:56:50 10.0.0.20  stp
Oct  4 09:56:50 10.0.0.20  xen_evtchn
Oct  4 09:56:50 10.0.0.20  xenfs
Oct  4 09:56:50 10.0.0.20  nfsd
Oct  4 09:56:50 10.0.0.20  exportfs
Oct  4 09:56:50 10.0.0.20  nfs
Oct  4 09:56:50 10.0.0.20  lockd
Oct  4 09:56:50 10.0.0.20  fscache
Oct  4 09:56:50 10.0.0.20  nfs_acl
Oct  4 09:56:50 10.0.0.20  auth_rpcgss
Oct  4 09:56:50 10.0.0.20  sunrpc
Oct  4 09:56:50 10.0.0.20  loop
Oct  4 09:56:50 10.0.0.20  snd_pcm
Oct  4 09:56:50 10.0.0.20  snd_timer
Oct  4 09:56:50 10.0.0.20  snd
Oct  4 09:56:50 10.0.0.20  soundcore
Oct  4 09:56:50 10.0.0.20  psmouse
Oct  4 09:56:50 10.0.0.20  pl2303
Oct  4 09:56:50 10.0.0.20  snd_page_alloc
Oct  4 09:56:50 10.0.0.20  usbserial
Oct  4 09:56:50 10.0.0.20  serio_raw
Oct  4 09:56:50 10.0.0.20  pcspkr
Oct  4 09:56:50 10.0.0.20  shpchp
Oct  4 09:56:50 10.0.0.20  evdev
Oct  4 09:56:50 10.0.0.20  dcdbas
Oct  4 09:56:50 10.0.0.20  pci_hotplug
Oct  4 09:56:50 10.0.0.20  i2c_piix4
Oct  4 09:56:50 10.0.0.20  i2c_core
Oct  4 09:56:50 10.0.0.20  processor
Oct  4 09:56:50 10.0.0.20  acpi_processor
Oct  4 09:56:50 10.0.0.20  button
Oct  4 09:56:50 10.0.0.20  ext3
Oct  4 09:56:50 10.0.0.20  jbd
Oct  4 09:56:50 10.0.0.20  mbcache
Oct  4 09:56:50 10.0.0.20  sg
Oct  4 09:56:50 10.0.0.20  sr_mod
Oct  4 09:56:50 10.0.0.20  cdrom
Oct  4 09:56:50 10.0.0.20  sd_mod
Oct  4 09:56:50 10.0.0.20  crc_t10dif
Oct  4 09:56:50 10.0.0.20  ata_generic
Oct  4 09:56:50 10.0.0.20  ohci_hcd
Oct  4 09:56:50 10.0.0.20  pata_serverworks
Oct  4 09:56:50 10.0.0.20  megaraid_mbox
Oct  4 09:56:50 10.0.0.20  megaraid_mm
Oct  4 09:56:50 10.0.0.20  tg3
Oct  4 09:56:50 10.0.0.20  floppy
Oct  4 09:56:50 10.0.0.20  aacraid
Oct  4 09:56:50 10.0.0.20  libphy
Oct  4 09:56:50 10.0.0.20  qla1280
Oct  4 09:56:50 10.0.0.20  ehci_hcd
Oct  4 09:56:50 10.0.0.20  libata
Oct  4 09:56:50 10.0.0.20  usbcore
Oct  4 09:56:50 10.0.0.20  nls_base
Oct  4 09:56:50 10.0.0.20  thermal
Oct  4 09:56:50 10.0.0.20  scsi_mod
Oct  4 09:56:50 10.0.0.20  thermal_sys
Oct  4 09:56:50 10.0.0.20  [last unloaded: scsi_wait_scan]
Oct  4 09:56:50 10.0.0.20
Oct  4 09:56:50 10.0.0.20 [174606.528507]
Oct  4 09:56:50 10.0.0.20 [174606.528507] Pid: 0, comm: swapper Tainted: 
G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
Oct  4 09:56:50 10.0.0.20 [174606.528507] EIP: 0061:[<c1059e6e>] EFLAGS: 
00000202 CPU: 1
Oct  4 09:56:50 10.0.0.20 [174606.528507] EIP is at 
smp_call_function_many+0xe9/0x17c
Oct  4 09:56:50 10.0.0.20 [174606.528507] EAX: c145a6dc EBX: 00000002 
ECX: 00000003 EDX: 03cd9000
Oct  4 09:56:50 10.0.0.20 [174606.528507] ESI: c51336dc EDI: 00000001 
EBP: c13fa2b4 ESP: ec847ba0
Oct  4 09:56:50 10.0.0.20 [174606.528507]  DS: 007b ES: 007b FS: 00d8 
GS: 00e0 SS: 0069
Oct  4 09:56:50 10.0.0.20 [174606.528507] CR0: 8005003b CR2: 094c7808 
CR3: 0a1c5000 CR4: 00000660
Oct  4 09:56:50 10.0.0.20 [174606.528507] DR0: 00000000 DR1: 00000000 
DR2: 00000000 DR3: 00000000
Oct  4 09:56:50 10.0.0.20 [174606.528507] DR6: ffff0ff0 DR7: 00000400
Oct  4 09:56:50 10.0.0.20 [174606.528507] Call Trace:
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1006d5c>] ? 
stop_self+0x0/0x30
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1059f1a>] ? 
smp_call_function+0x19/0x1f
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10036be>] ? 
xen_reboot+0x14/0x28
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1003705>] ? 
xen_panic_event+0xa/0xd
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128f990>] ? 
notifier_call_chain+0x2a/0x47
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128f9c0>] ? 
atomic_notifier_call_chain+0xc/0xf
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128c1af>] ? panic+0x56/0xe4
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128e799>] ? 
oops_end+0x91/0x9d
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009f21>] ? 
do_invalid_op+0x0/0x75
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009f8d>] ? 
do_invalid_op+0x6c/0x75
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1092fc1>] ? 
__alloc_pages_nodemask+0xf3/0x4e0
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128de8b>] ? 
error_code+0x73/0x78
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c119803b>] ? 
gnttab_copy_grant_page+0x17d/0x22c
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c11a49ca>] ? 
net_tx_action+0x1c8/0xeb1
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10211e3>] ? 
pvclock_clocksource_read+0xf9/0x10f
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c113d59e>] ? 
cpumask_next_and+0x23/0x33
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c102f8c8>] ? 
find_busiest_group+0x2e9/0x6e6
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1034131>] ? 
rebalance_domains+0x149/0x3e1
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1005fb8>] ? 
xen_force_evtchn_callback+0xc/0x10
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
check_events+0x8/0xc
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066d7>] ? 
xen_restore_fl_direct_end+0x0/0x1
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128dca1>] ? 
_spin_unlock_irqrestore+0xd/0xf
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103b17e>] ? 
tasklet_action+0x67/0xad
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c2e0>] ? 
__do_softirq+0xaa/0x151
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c3b8>] ? 
do_softirq+0x31/0x3c
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c48e>] ? 
irq_exit+0x26/0x58
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1198c15>] ? 
xen_evtchn_do_upcall+0x22/0x2c
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009abf>] ? 
xen_do_upcall+0x7/0xc
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10023a7>] ? 
hypercall_page+0x3a7/0x1001
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1006039>] ? 
xen_safe_halt+0xf/0x1b
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1004137>] ? 
xen_idle+0x23/0x30
Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10080a8>] ? 
cpu_idle+0x89/0xa5





Severity set to 'important' from 'grave' Request was from Ben Hutchings <ben@decadent.org.uk> to control@bugs.debian.org. (Mon, 04 Oct 2010 16:09:02 GMT) Full text and rfc822 format available.

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 09:51:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ian Campbell <ijc@hellion.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 09:51:05 GMT) Full text and rfc822 format available.

Message #12 received at 599089@bugs.debian.org (full text, mbox):

From: Ian Campbell <ijc@hellion.org.uk>
To: Jason Kendall <jakendall@gmail.com>, 599089@bugs.debian.org
Cc: Jeremy Fitzhardinge <jeremy@goop.org>, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 10:47:39 +0100
Hi Jason,

Thanks for the report.

You stack trace looks pretty similar to one reported upstream over the
summer:
http://lists.xensource.com/archives/html/xen-devel/2010-06/msg00831.html

Unfortunately I don't think anyone ever got to the bottom of the issue.

Luckily I've been able to reproduce reasonably easily (it seems transfer
from domU to dom0 is the key rather than vice versa).

The stack trace shows that the kernel has hit a pretty rare code path.
It is trying to copy domU skb data into dom0 memory because the skb has
been in the dom0 network stack. It does this so that the guest memory
can be returned to the guest so that it doesn't all end up sitting in
the dom0 network stack. Obviously something is going wrong with this.

In addition to the kernel logging of the error I get this from the
hypervisor:
(XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
(XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
(XEN) mm.c:3621:d0 Could not get page for mach->phys update

which is consistent with the kernel's BUG_ON.

Ian.

On Mon, 2010-10-04 at 11:13 -0400, Jason Kendall wrote:
> Package: linux-2.6
> Version: 2.6.32-23
> Severity: grave
> Tags: upstream
> Justification: renders package unusable
> 
> 
> -- Running NFS inside of a DomU when connected to Dom0 causes kernel 
> panic within a few minutes. Does not matter which DomU the NFS is 
> connected from. Does not happen when connecting to NFS outside of the 
> Xen enviroment.
> 
> Notes I've made while diagnosing this issue:
> 
> 1. Able to run multiple Xen DomUs (8 in total)
> 2. MX1 has a NFS connection to Dom0 (/home) for mail delivery.
> 3. I can run MX1 without NFS with no issues, No oops or any issues
> 4. within a few mins of mounting NFS on MX1 Dom0 crashes
> 5. Clock-sources are a mixture of XEN and TSC (Xen is default, moved 2 
> DomUs to TSC as a troubleshooting step (aaa and MX1)
> 6. Mounted /home on a different DomU as a test..
> 7. Leaving the NFS mount on a different DomU did not cause Panic, 
> however, no traffic happened left it for a few hours and no panic.
> 8. Started moving files between NFS and local DomU drive and Panic happened.
> 9. Coping large amounts of files within the DomU (not over NFS) did not 
> seem to cause Oops.
> 10. Created NFS share on desktop which is not part of the Xen server to 
> see if it causes a panic (Identifies if this is a Dom0 or DomU issue)
> NOTE: Dom0 has /home which the desktop can access perfectly fine.
> 11. Moving files from Desktop NFS is ok.
> 
> Recap:
> 
> DomU <-> DomU: Ok
> DomU <-> Desktop NFS: OK
> DomU <-> Dom0: Oops
> Desktop <-> Dom0: OK
> 
> 
> -- Package-specific info:
> ** Version:
> Linux version 2.6.32-5-xen-686 (Debian 2.6.32-23) (dannf@debian.org) 
> (gcc version 4.3.5 (Debian 4.3.5-3) ) #1 SMP Sat Sep 18 06:00:14 UTC 2010
> 
> ** Command line:
> placeholder root=UUID=6b304f06-c37f-480f-af92-478443531682 ro quiet
> 
> ** Not tainted
> 
> ** Kernel log:
> [  157.841231] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.841242] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.841253] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.841265] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872702] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872718] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872728] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872738] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872748] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872759] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872769] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872778] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872788] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872798] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872808] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872818] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.872828] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884349] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884372] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884388] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884405] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884420] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884437] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884455] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884471] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884488] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884506] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884521] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884537] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884555] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  157.884570] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  161.642902] blkback: ring-ref 8, event-channel 8, protocol 1 (x86_32-abi)
> [  161.935808] blkback: ring-ref 9, event-channel 9, protocol 1 (x86_32-abi)
> [  168.717532] vif7.0: no IPv6 routers present
> [  172.787784] device vif8.0 entered promiscuous mode
> [  172.797787] eth0: port 9(vif8.0) entering forwarding state
> [  172.848319] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848343] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848359] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848374] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848388] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848402] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848420] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848437] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848453] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848468] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848482] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848496] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848511] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.848526] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860830] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860843] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860854] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860864] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860874] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860884] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860894] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860904] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860914] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860924] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860934] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860944] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860954] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860963] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.860974] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874077] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874091] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874101] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874111] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874121] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874131] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874141] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874151] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874161] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874170] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874180] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874190] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874200] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874210] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.874220] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.887977] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.887995] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888088] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888119] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888134] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888152] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888171] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888186] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888202] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888222] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888236] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888252] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888270] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888286] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888301] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  172.888321] physdev match: using --physdev-out in the OUTPUT, FORWARD 
> and POSTROUTING chains for non-bridged traffic is not supported anymore.
> [  177.711666] blkback: ring-ref 8, event-channel 8, protocol 1 (x86_32-abi)
> [  178.054806] blkback: ring-ref 9, event-channel 9, protocol 1 (x86_32-abi)
> [  181.495854] Switching to clocksource tsc
> [  182.880089] vif8.0: no IPv6 routers present
> 
> ** Model information
> not available
> 
> ** Loaded modules:
> Module                  Size  Used by
> xt_tcpudp               1743  8
> nf_conntrack_ipv4       7597  16
> nf_defrag_ipv4           779  1 nf_conntrack_ipv4
> xt_state                 927  16
> nf_conntrack           38079  2 nf_conntrack_ipv4,xt_state
> xt_physdev              1228  32
> iptable_filter          1790  1
> ip_tables               7690  1 iptable_filter
> x_tables                8327  4 xt_tcpudp,xt_state,xt_physdev,ip_tables
> bridge                 32999  0
> stp                      996  1 bridge
> xen_evtchn              3471  9
> xenfs                   7248  1
> nfsd                  193247  13
> exportfs                2618  1 nfsd
> nfs                   206894  0
> lockd                  49433  2 nfsd,nfs
> fscache                24654  1 nfs
> nfs_acl                 1695  2 nfsd,nfs
> auth_rpcgss            25240  2 nfsd,nfs
> sunrpc                134572  14 nfsd,nfs,lockd,nfs_acl,auth_rpcgss
> loop                    9761  32
> snd_pcm                47402  0
> snd_timer              12258  1 snd_pcm
> pl2303                 11624  0
> dcdbas                  3940  0
> snd                    34363  2 snd_pcm,snd_timer
> usbserial              21843  1 pl2303
> soundcore               3450  1 snd
> snd_page_alloc          5109  1 snd_pcm
> psmouse                44653  0
> pcspkr                  1207  0
> serio_raw               2916  0
> shpchp                 21264  0
> evdev                   5609  2
> i2c_piix4               7124  0
> pci_hotplug            18065  1 shpchp
> i2c_core               12696  1 i2c_piix4
> button                  3598  0
> processor              31041  0
> acpi_processor          3623  1 processor,[permanent]
> ext3                   94196  2
> jbd                    32161  1 ext3
> mbcache                 3762  1 ext3
> sr_mod                 10770  0
> cdrom                  26487  1 sr_mod
> ata_generic             2019  0
> sg                     15972  0
> sd_mod                 25865  5
> crc_t10dif              1012  1 sd_mod
> megaraid_mbox          21022  0
> pata_serverworks        3969  0
> ohci_hcd               17068  0
> megaraid_mm             5451  1 megaraid_mbox
> libata                116021  2 ata_generic,pata_serverworks
> qla1280                16957  0
> tg3                    88633  0
> floppy                 40931  0
> aacraid                51565  3
> libphy                 11638  1 tg3
> ehci_hcd               28255  0
> scsi_mod              101397  7 
> sr_mod,sg,sd_mod,megaraid_mbox,libata,qla1280,aacraid
> usbcore                98725  5 pl2303,usbserial,ohci_hcd,ehci_hcd
> nls_base                4541  1 usbcore
> thermal                 9206  0
> thermal_sys             9378  2 processor,thermal
> 
> ** Network interface configuration:
> 
> auto lo
> iface lo inet loopback
> 
> allow-hotplug eth0
> iface eth0 inet static
>   address 10.0.0.20
>   netmask 255.255.255.0
>   broadcast 10.0.0.255
>   gateway 10.0.0.1
>   dns-domain lab.ostlabs.com
>   dns-nameservers 10.0.0.1
> 
> ** Network status:
> *** IP interfaces and addresses:
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>      inet 127.0.0.1/8 scope host lo
>      inet6 ::1/128 scope host
>         valid_lft forever preferred_lft forever
> 2: peth0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq 
> state UP qlen 1000
>      link/ether 00:06:5b:f7:eb:c3 brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::206:5bff:fef7:ebc3/64 scope link
>         valid_lft forever preferred_lft forever
> 3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
>      link/ether 00:06:5b:f7:eb:c4 brd ff:ff:ff:ff:ff:ff
> 4: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state 
> UNKNOWN
>      link/ether 00:06:5b:f7:eb:c3 brd ff:ff:ff:ff:ff:ff
>      inet 10.0.0.20/24 brd 10.0.0.255 scope global eth0
>      inet6 fe80::206:5bff:fef7:ebc3/64 scope link
>         valid_lft forever preferred_lft forever
> 5: vif1.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 6: vif2.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 7: vif3.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 8: vif4.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 9: vif5.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 10: vif6.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 11: vif7.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 12: vif8.0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc 
> pfifo_fast state UNKNOWN qlen 32
>      link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
>      inet6 fe80::fcff:ffff:feff:ffff/64 scope link
>         valid_lft forever preferred_lft forever
> 
> *** Device statistics:
> Inter-|   Receive                                                |  Transmit
>   face |bytes    packets errs drop fifo frame compressed 
> multicast|bytes    packets errs drop fifo colls carrier compressed
>      lo:   12990     151    0    0    0     0          0         0    
> 12990     151    0    0    0     0       0          0
>   peth0:33668865   52529    0    0    0     0          0      1400 
> 40069263   51090    0    0    0     0       0          0
>    eth1:       0       0    0    0    0     0          0         
> 0        0       0    0    0    0     0       0          0
>    eth0:32154816   49419    0    0    0     0          0      2082 
> 38628135   34224    0    0    0     0       0          0
> vif1.0:  320314    3264    0    0    0     0          0         0   
> 742272    6508    0   13    0     0       0          0
> vif2.0:  547294    6543    0    0    0     0          0         0  
> 1059726    7321    0    9    0     0       0          0
> vif3.0:  606762    1869    0    0    0     0          0         0   
> 633826    4139    0   13    0     0       0          0
> vif4.0:   67861     381    0    0    0     0          0         0   
> 336287    2440    0   13    0     0       0          0
> vif5.0:  118042    1447    0    0    0     0          0         0   
> 466361    3261    0   15    0     0       0          0
> vif6.0:  346370    2546    0    0    0     0          0         0   
> 956549    4325    0   16    0     0       0          0
> vif7.0:   18773     316    0    0    0     0          0         0   
> 303830    2198    0   10    0     0       0          0
> vif8.0:     804      13    0    0    0     0          0         0   
> 271472    1921    0   16    0     0       0          0
> 
> *** Protocol statistics:
> Ip:
>      48197 total packets received
>      38 with invalid addresses
>      0 forwarded
>      0 incoming packets discarded
>      48009 incoming packets delivered
>      34936 requests sent out
>      13 dropped because of missing route
> Icmp:
>      6 ICMP messages received
>      0 input ICMP message failed.
>      ICMP input histogram:
>          destination unreachable: 6
>      73 ICMP messages sent
>      0 ICMP messages failed
>      ICMP output histogram:
>          destination unreachable: 73
> IcmpMsg:
>          InType3: 6
>          OutType3: 73
> Tcp:
>      11 active connections openings
>      38 passive connection openings
>      6 failed connection attempts
>      0 connection resets received
>      3 connections established
>      47193 segments received
>      34001 segments send out
>      25 segments retransmited
>      0 bad segments received.
>      8 resets sent
> Udp:
>      416 packets received
>      67 packets to unknown port received.
>      0 packet receive errors
>      841 packets sent
> UdpLite:
> TcpExt:
>      3 TCP sockets finished time wait in fast timer
>      109 delayed acks sent
>      5 delayed acks further delayed because of locked socket
>      1 packets directly queued to recvmsg prequeue.
>      26117 packet headers predicted
>      940 acknowledgments not containing data payload received
>      24570 predicted acknowledgments
>      2 times recovered from packet loss by selective acknowledgements
>      76 TCP data loss events
>      TCPLostRetransmit: 4
>      25 fast retransmits
>      TCPSackShifted: 74
>      TCPSackMerged: 135
>      TCPSackShiftFallback: 20
> IpExt:
>      InBcastPkts: 602
>      OutBcastPkts: 51
>      InOctets: 32108796
>      OutOctets: 38224368
>      InBcastOctets: 159844
>      OutBcastOctets: 7380
> 
> *** Device features:
> eth0: 0x11823
> eth1: 0x9a3
> lo: 0x13865
> peth0: 0x9a3
> vif1.0: 0x10803
> vif2.0: 0x10803
> vif3.0: 0x10803
> vif4.0: 0x10803
> vif5.0: 0x10803
> vif6.0: 0x10803
> vif7.0: 0x10803
> vif8.0: 0x10803
> 
> ** PCI devices:
> 00:00.0 Host bridge [0600]: Broadcom CMIC-WS Host Bridge (GC-LE chipset) 
> [1166:0012] (rev 13)
>      Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 
> 00:00.1 Host bridge [0600]: Broadcom CMIC-WS Host Bridge (GC-LE chipset) 
> [1166:0012]
>      Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 
> 00:00.2 Host bridge [0600]: Broadcom CMIC-LE [1166:0000]
>      Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> 
> 00:04.0 Unassigned class [ff00]: Dell Embedded Remote Access or ERA/O 
> [1028:000c]
>      Subsystem: Dell Embedded Remote Access or ERA/O [1028:000c]
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32, Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 11
>      Region 0: Memory at feb80000 (32-bit, prefetchable) [size=4K]
>      Region 1: I/O ports at ecf8 [size=8]
>      Region 2: I/O ports at ece8 [size=8]
>      Expansion ROM at fe000000 [disabled] [size=64K]
>      Capabilities: <access denied>
> 
> 00:04.1 Unassigned class [ff00]: Dell Remote Access Card III [1028:0008]
>      Subsystem: Dell Remote Access Card III [1028:0008]
>      Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Interrupt: pin B routed to IRQ 23
>      Region 0: Memory at fe102000 (32-bit, non-prefetchable) [size=4K]
>      Region 1: I/O ports at ec80 [size=64]
>      Region 2: Memory at feb00000 (32-bit, prefetchable) [size=512K]
>      Capabilities: <access denied>
>      Kernel driver in use: serial
> 
> 00:04.2 Unassigned class [ff00]: Dell Embedded Remote Access: BMC/SMIC 
> device [1028:000d]
>      Subsystem: Dell Embedded Remote Access: BMC/SMIC device [1028:000d]
>      Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Interrupt: pin C routed to IRQ 7
>      Region 0: I/O ports at ecf4 [size=4]
>      Capabilities: <access denied>
> 
> 00:0e.0 VGA compatible controller [0300]: ATI Technologies Inc Rage XL 
> [1002:4752] (rev 27) (prog-if 00 [VGA controller])
>      Subsystem: Dell Device [1028:0121]
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop+ ParErr- 
> Stepping+ SERR- FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32 (2000ns min), Cache Line Size: 64 bytes
>      Region 0: Memory at fd000000 (32-bit, non-prefetchable) [size=16M]
>      Region 1: I/O ports at e800 [size=256]
>      Region 2: Memory at fe101000 (32-bit, non-prefetchable) [size=4K]
>      [virtual] Expansion ROM at e8000000 [disabled] [size=128K]
>      Capabilities: <access denied>
> 
> 00:0f.0 Host bridge [0600]: Broadcom CSB5 South Bridge [1166:0201] (rev 93)
>      Subsystem: Broadcom CSB5 South Bridge [1166:0201]
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Latency: 32
>      Kernel driver in use: piix4_smbus
> 
> 00:0f.1 IDE interface [0101]: Broadcom CSB5 IDE Controller [1166:0212] 
> (rev 93) (prog-if 82 [Master PriP])
>      Subsystem: Broadcom CSB5 IDE Controller [1166:0212]
>      Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 64
>      Region 0: I/O ports at 01f0 [size=8]
>      Region 1: I/O ports at 03f4 [size=1]
>      Region 2: I/O ports at 0170 [size=8]
>      Region 3: I/O ports at 0374 [size=1]
>      Region 4: I/O ports at 08b0 [size=16]
>      Kernel driver in use: pata_serverworks
> 
> 00:0f.2 USB Controller [0c03]: Broadcom OSB4/CSB5 OHCI USB Controller 
> [1166:0220] (rev 05) (prog-if 10 [OHCI])
>      Subsystem: Broadcom OSB4/CSB5 OHCI USB Controller [1166:0220]
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32 (20000ns max)
>      Interrupt: pin A routed to IRQ 11
>      Region 0: Memory at fe100000 (32-bit, non-prefetchable) [size=4K]
>      Kernel driver in use: ohci_hcd
> 
> 00:0f.3 ISA bridge [0601]: Broadcom CSB5 LPC bridge [1166:0225]
>      Subsystem: Broadcom Dell PowerEdge 1650/1750 [1166:0230]
>      Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR- FastB2B- DisINTx-
>      Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 0
> 
> 00:10.0 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
> [1166:0101] (rev 03)
>      Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Capabilities: <access denied>
> 
> 00:10.2 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
> [1166:0101] (rev 03)
>      Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Capabilities: <access denied>
> 
> 00:11.0 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
> [1166:0101] (rev 05)
>      Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Capabilities: <access denied>
> 
> 00:11.2 Host bridge [0600]: Broadcom CIOB-X2 PCI-X I/O Bridge 
> [1166:0101] (rev 05)
>      Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+ 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Capabilities: <access denied>
> 
> 02:06.0 PCI bridge [0604]: Intel Corporation 21154 PCI-to-PCI Bridge 
> [8086:b154] (prog-if 00 [Normal decode])
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32
>      Bus: primary=02, secondary=03, subordinate=04, sec-latency=32
>      I/O behind bridge: 0000d000-0000dfff
>      Memory behind bridge: fcd00000-fcffffff
>      Prefetchable memory behind bridge: 00000000f0000000-00000000f7ffffff
>      Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- <SERR- <PERR-
>      BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
>          PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
>      Capabilities: <access denied>
> 
> 03:00.0 PCI bridge [0604]: Intel Corporation 21154 PCI-to-PCI Bridge 
> [8086:b154] (prog-if 00 [Normal decode])
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32
>      Bus: primary=03, secondary=04, subordinate=04, sec-latency=32
>      Memory behind bridge: fcf00000-fcffffff
>      Prefetchable memory behind bridge: 00000000f0000000-00000000f7ffffff
>      Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ <SERR- <PERR-
>      BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
>          PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
>      Capabilities: <access denied>
> 
> 03:01.0 SCSI storage controller [0100]: QLogic Corp. ISP12160 Dual 
> Channel Ultra3 SCSI Processor [1077:1216] (rev 06)
>      Subsystem: American Megatrends Inc. QLA12160 on AMI MegaRAID 
> [101e:8493]
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32 (16000ns min), Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 11
>      Region 0: I/O ports at dc00 [size=256]
>      Region 1: Memory at fcdff000 (32-bit, non-prefetchable) [size=4K]
>      Expansion ROM at fce00000 [disabled] [size=128K]
>      Capabilities: <access denied>
> 
> 04:00.0 RAID bus controller [0104]: American Megatrends Inc. MegaRAID 
> [101e:1960] (rev 20)
>      Subsystem: Dell PowerEdge RAID Controller 3/DC [1028:0493]
>      Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Latency: 32, Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 24
>      Region 0: Memory at f0000000 (32-bit, prefetchable) [size=128M]
>      Expansion ROM at fcf00000 [disabled] [size=128K]
>      Capabilities: <access denied>
>      Kernel driver in use: megaraid
> 
> 05:06.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme 
> BCM5701 Gigabit Ethernet [14e4:1645] (rev 15)
>      Subsystem: Dell Broadcom BCM5701 1000Base-T [1028:0121]
>      Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 64 (16000ns min), Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 28
>      Region 0: Memory at eff10000 (64-bit, non-prefetchable) [size=64K]
>      Capabilities: <access denied>
>      Kernel driver in use: tg3
> 
> 05:08.0 Ethernet controller [0200]: Broadcom Corporation NetXtreme 
> BCM5701 Gigabit Ethernet [14e4:1645] (rev 15)
>      Subsystem: Dell Broadcom BCM5701 1000Base-T [1028:0121]
>      Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 64 (16000ns min), Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 29
>      Region 0: Memory at eff00000 (64-bit, non-prefetchable) [size=64K]
>      Capabilities: <access denied>
>      Kernel driver in use: tg3
> 
> 06:08.0 PCI bridge [0604]: Intel Corporation 80303 I/O Processor 
> PCI-to-PCI Bridge [8086:0309] (rev 01) (prog-if 00 [Normal decode])
>      Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- 
> <TAbort- <MAbort- >SERR- <PERR- INTx-
>      Latency: 32, Cache Line Size: 64 bytes
>      Bus: primary=06, secondary=07, subordinate=07, sec-latency=32
>      Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- 
> <TAbort- <MAbort+ <SERR- <PERR-
>      BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
>          PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
>      Capabilities: <access denied>
> 
> 06:08.1 RAID bus controller [0104]: Dell PowerEdge Expandable RAID 
> Controller 3/Di [1028:000a] (rev 01)
>      Subsystem: Dell PERC 3/DiB [Boxster] [1028:0121]
>      Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
> Stepping- SERR+ FastB2B- DisINTx-
>      Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- 
> <TAbort- <MAbort+ >SERR- <PERR- INTx-
>      Latency: 32, Cache Line Size: 64 bytes
>      Interrupt: pin A routed to IRQ 30
>      Region 0: Memory at e0000000 (32-bit, prefetchable) [size=128M]
>      Expansion ROM at efd00000 [disabled] [size=64K]
>      Capabilities: <access denied>
>      Kernel driver in use: aacraid
> 
> 
> ** USB devices:
> Bus 001 Device 002: ID 067b:aaa0 Prolific Technology, Inc. Prolific Pharos
> Bus 001 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> 
> 
> -- System Information:
> Debian Release: squeeze/sid
>    APT prefers testing
>    APT policy: (500, 'testing')
> Architecture: i386 (i686)
> 
> Kernel: Linux 2.6.32-5-xen-686 (SMP w/4 CPU cores)
> Locale: LANG=en_CA.UTF-8, LC_CTYPE=en_CA.UTF-8 (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/dash
> 
> Versions of packages linux-image-2.6.32-5-xen-686 depends on:
> ii  debconf [debconf-2.0]         1.5.35     Debian configuration 
> management sy
> ii  initramfs-tools               0.98.4     tools for generating an 
> initramfs
> ii  linux-base                    2.6.32-23  Linux image base package
> ii  module-init-tools             3.12-1     tools for managing Linux 
> kernel mo
> 
> Versions of packages linux-image-2.6.32-5-xen-686 recommends:
> ii  firmware-linux-free           2.6.32-23  Binary firmware for various 
> driver
> ii  libc6-xen                     2.11.2-6   Embedded GNU C Library: 
> Shared lib
> 
> Versions of packages linux-image-2.6.32-5-xen-686 suggests:
> pn  grub <none>     (no description available)
> pn  linux-doc-2.6.32 <none>     (no description available)
> 
> Versions of packages linux-image-2.6.32-5-xen-686 is related to:
> pn  firmware-bnx2 <none>     (no description available)
> pn  firmware-bnx2x <none>     (no description available)
> pn  firmware-ipw2x00 <none>     (no description available)
> pn  firmware-ivtv <none>     (no description available)
> pn  firmware-iwlwifi <none>     (no description available)
> pn  firmware-linux <none>     (no description available)
> pn  firmware-linux-nonfree <none>     (no description available)
> pn  firmware-qlogic <none>     (no description available)
> pn  firmware-ralink <none>     (no description available)
> ii  xen-hypervisor-4.0-i386 [xen- 4.0.1-1    The Xen Hypervisor on i386
> 
> -- debconf information:
>    
> linux-image-2.6.32-5-xen-686/postinst/depmod-error-initrd-2.6.32-5-xen-686: 
> false
>    
> linux-image-2.6.32-5-xen-686/postinst/ignoring-do-bootloader-2.6.32-5-xen-686:
>    
> linux-image-2.6.32-5-xen-686/prerm/removing-running-kernel-2.6.32-5-xen-686: 
> true
>    linux-image-2.6.32-5-xen-686/postinst/missing-firmware-2.6.32-5-xen-686:
> 
> ------ netconsole Trace:
> 
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281586] netconsole: local port 
> 6666
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281599] netconsole: local IP 
> 10.0.0.20
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281605] netconsole: interface eth0
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281612] netconsole: remote 
> port 514
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281619] netconsole: remote IP 
> 10.0.0.100
> Oct  4 09:45:31 10.0.0.20 kernel: [173927.281627] netconsole: remote 
> ethernet address 00:1a:70:11:c5:ff
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595807] netconsole: local port 
> 6666
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595820] netconsole: local IP 
> 10.0.0.20
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595830] netconsole: interface 
> peth0
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595839] netconsole: remote 
> port 514
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595848] netconsole: remote IP 
> 10.0.0.100
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.595859] netconsole: remote 
> ethernet address 00:1a:70:11:c5:ff
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.605629] console [netcon0] enabled
> Oct  4 09:45:47 10.0.0.20 kernel: [173943.605636] netconsole: network 
> logging started
> Oct  4 09:52:29 10.0.0.20 [174345.332640] ------------[ cut here 
> ]------------
> Oct  4 09:52:29 10.0.0.20 [174345.332716] kernel BUG at 
> /build/buildd-linux-2.6_2.6.32-23-i386-x1D1UQ/linux-2.6-2.6.32/debian/build/source_i386_xen/drivers/xen/grant-table.c:584! 
> 
> Oct  4 09:52:29 10.0.0.20 [174345.332805] invalid opcode: 0000 [#1]
> Oct  4 09:52:29 10.0.0.20 SMP
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.332903] last sysfs file: 
> /sys/module/configfs/initstate
> Oct  4 09:52:29 10.0.0.20 [174345.332952] Modules linked in:
> Oct  4 09:52:29 10.0.0.20  netconsole
> Oct  4 09:52:29 10.0.0.20  configfs
> Oct  4 09:52:29 10.0.0.20  xt_tcpudp
> Oct  4 09:52:29 10.0.0.20  nf_conntrack_ipv4
> Oct  4 09:52:29 10.0.0.20  nf_defrag_ipv4
> Oct  4 09:52:29 10.0.0.20  xt_state
> Oct  4 09:52:29 10.0.0.20  nf_conntrack
> Oct  4 09:52:29 10.0.0.20  xt_physdev
> Oct  4 09:52:29 10.0.0.20  iptable_filter
> Oct  4 09:52:29 10.0.0.20  ip_tables
> Oct  4 09:52:29 10.0.0.20  x_tables
> Oct  4 09:52:29 10.0.0.20  bridge
> Oct  4 09:52:29 10.0.0.20  stp
> Oct  4 09:52:29 10.0.0.20  xen_evtchn
> Oct  4 09:52:29 10.0.0.20  xenfs
> Oct  4 09:52:29 10.0.0.20  nfsd
> Oct  4 09:52:29 10.0.0.20  exportfs
> Oct  4 09:52:29 10.0.0.20  nfs
> Oct  4 09:52:29 10.0.0.20  lockd
> Oct  4 09:52:29 10.0.0.20  fscache
> Oct  4 09:52:29 10.0.0.20  nfs_acl
> Oct  4 09:52:29 10.0.0.20  auth_rpcgss
> Oct  4 09:52:29 10.0.0.20  sunrpc
> Oct  4 09:52:29 10.0.0.20  loop
> Oct  4 09:52:29 10.0.0.20  snd_pcm
> Oct  4 09:52:29 10.0.0.20  snd_timer
> Oct  4 09:52:29 10.0.0.20  snd
> Oct  4 09:52:29 10.0.0.20  soundcore
> Oct  4 09:52:29 10.0.0.20  psmouse
> Oct  4 09:52:29 10.0.0.20  pl2303
> Oct  4 09:52:29 10.0.0.20  snd_page_alloc
> Oct  4 09:52:29 10.0.0.20  usbserial
> Oct  4 09:52:29 10.0.0.20  serio_raw
> Oct  4 09:52:29 10.0.0.20  pcspkr
> Oct  4 09:52:29 10.0.0.20  shpchp
> Oct  4 09:52:29 10.0.0.20  evdev
> Oct  4 09:52:29 10.0.0.20  dcdbas
> Oct  4 09:52:29 10.0.0.20  pci_hotplug
> Oct  4 09:52:29 10.0.0.20  i2c_piix4
> Oct  4 09:52:29 10.0.0.20  i2c_core
> Oct  4 09:52:29 10.0.0.20  processor
> Oct  4 09:52:29 10.0.0.20  acpi_processor
> Oct  4 09:52:29 10.0.0.20  button
> Oct  4 09:52:29 10.0.0.20  ext3
> Oct  4 09:52:29 10.0.0.20  jbd
> Oct  4 09:52:29 10.0.0.20  mbcache
> Oct  4 09:52:29 10.0.0.20  sg
> Oct  4 09:52:29 10.0.0.20  sr_mod
> Oct  4 09:52:29 10.0.0.20  cdrom
> Oct  4 09:52:29 10.0.0.20  sd_mod
> Oct  4 09:52:29 10.0.0.20  crc_t10dif
> Oct  4 09:52:29 10.0.0.20  ata_generic
> Oct  4 09:52:29 10.0.0.20  ohci_hcd
> Oct  4 09:52:29 10.0.0.20  pata_serverworks
> Oct  4 09:52:29 10.0.0.20  megaraid_mbox
> Oct  4 09:52:29 10.0.0.20  megaraid_mm
> Oct  4 09:52:29 10.0.0.20  tg3
> Oct  4 09:52:29 10.0.0.20  floppy
> Oct  4 09:52:29 10.0.0.20  aacraid
> Oct  4 09:52:29 10.0.0.20  libphy
> Oct  4 09:52:29 10.0.0.20  qla1280
> Oct  4 09:52:29 10.0.0.20  ehci_hcd
> Oct  4 09:52:29 10.0.0.20  libata
> Oct  4 09:52:29 10.0.0.20  usbcore
> Oct  4 09:52:29 10.0.0.20  nls_base
> Oct  4 09:52:29 10.0.0.20  thermal
> Oct  4 09:52:29 10.0.0.20  scsi_mod
> Oct  4 09:52:29 10.0.0.20  thermal_sys
> Oct  4 09:52:29 10.0.0.20  [last unloaded: scsi_wait_scan]
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.334427]
> Oct  4 09:52:29 10.0.0.20 [174345.334472] Pid: 0, comm: swapper Not 
> tainted (2.6.32-5-xen-686 #1) PowerEdge 2650
> Oct  4 09:52:29 10.0.0.20 [174345.334549] EIP: 0061:[<c119803b>] EFLAGS: 
> 00010282 CPU: 1
> Oct  4 09:52:29 10.0.0.20 [174345.334622] EIP is at 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:52:29 10.0.0.20 [174345.334674] EAX: ffffffea EBX: ec847d40 
> ECX: 00000001 EDX: 00000000
> Oct  4 09:52:29 10.0.0.20 [174345.334725] ESI: 00007ff0 EDI: e9976000 
> EBP: 18375001 ESP: ec847d10
> Oct  4 09:52:29 10.0.0.20 [174345.334777]  DS: 007b ES: 007b FS: 00d8 
> GS: 00e0 SS: 0069
> Oct  4 09:52:29 10.0.0.20 [174345.334828] Process swapper (pid: 0, 
> ti=ec846000 task=ec838880 task.ti=ec846000)
> Oct  4 09:52:29 10.0.0.20 [174345.334900] Stack:
> Oct  4 09:52:29 10.0.0.20 [174345.334953]  000020d1
> Oct  4 09:52:29 10.0.0.20  c2424798
> Oct  4 09:52:29 10.0.0.20  000000ba
> Oct  4 09:52:29 10.0.0.20  c2eaea20
> Oct  4 09:52:29 10.0.0.20  c339fea0
> Oct  4 09:52:29 10.0.0.20  c20d1000
> Oct  4 09:52:29 10.0.0.20  c20d1000
> Oct  4 09:52:29 10.0.0.20  00000000
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.335118] <0>
> Oct  4 09:52:29 10.0.0.20  e9975000
> Oct  4 09:52:29 10.0.0.20  00000000
> Oct  4 09:52:29 10.0.0.20  000000ba
> Oct  4 09:52:29 10.0.0.20  117f0000
> Oct  4 09:52:29 10.0.0.20  18375001
> Oct  4 09:52:29 10.0.0.20  00000000
> Oct  4 09:52:29 10.0.0.20  000020d1
> Oct  4 09:52:29 10.0.0.20  00000000
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.335327] <0>
> Oct  4 09:52:29 10.0.0.20  ed811c70
> Oct  4 09:52:29 10.0.0.20  ed811da8
> Oct  4 09:52:29 10.0.0.20  ed81161c
> Oct  4 09:52:29 10.0.0.20  0006a875
> Oct  4 09:52:29 10.0.0.20  c11a49ca
> Oct  4 09:52:29 10.0.0.20  117fe518
> Oct  4 09:52:29 10.0.0.20  00009e8f
> Oct  4 09:52:29 10.0.0.20  117fe518
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.335573] Call Trace:
> Oct  4 09:52:29 10.0.0.20 [174345.335625]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:52:29 10.0.0.20 [174345.335682]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:52:29 10.0.0.20 [174345.335740]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:52:29 10.0.0.20 [174345.335795]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:52:29 10.0.0.20 [174345.335852]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:52:29 10.0.0.20 [174345.335908]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:52:29 10.0.0.20 [174345.335963]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336031]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:52:29 10.0.0.20 [174345.336110]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336176]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:52:29 10.0.0.20 [174345.336247]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:52:29 10.0.0.20 [174345.336318]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:52:29 10.0.0.20 [174345.336384]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:52:29 10.0.0.20 [174345.336437]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:52:29 10.0.0.20 [174345.336490]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> Oct  4 09:52:29 10.0.0.20 [174345.336513] Code:
> Oct  4 09:52:29 10.0.0.20 00
> Oct  4 09:52:29 10.0.0.20 31
> Oct  4 09:52:29 10.0.0.20 d2
> Oct  4 09:52:29 10.0.0.20 8b
> Oct  4 09:52:29 10.0.0.20 04
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 89
> Oct  4 09:52:29 10.0.0.20 6c
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 30
> Oct  4 09:52:29 10.0.0.20 8d
> Oct  4 09:52:29 10.0.0.20 5c
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 30
> Oct  4 09:52:29 10.0.0.20 c7
> Oct  4 09:52:29 10.0.0.20 44
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 34
> Oct  4 09:52:29 10.0.0.20 00
> Oct  4 09:52:29 10.0.0.20 last message repeated 3 times
> Oct  4 09:52:29 10.0.0.20 89
> Oct  4 09:52:29 10.0.0.20 44
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 38
> Oct  4 09:52:29 10.0.0.20 c7
> Oct  4 09:52:29 10.0.0.20 44
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 3c
> Oct  4 09:52:29 10.0.0.20 00
> Oct  4 09:52:29 10.0.0.20 last message repeated 3 times
> Oct  4 09:52:29 10.0.0.20 e8
> Oct  4 09:52:29 10.0.0.20 e9
> Oct  4 09:52:29 10.0.0.20 9f
> Oct  4 09:52:29 10.0.0.20 e6
> Oct  4 09:52:29 10.0.0.20 ff
> Oct  4 09:52:29 10.0.0.20 85
> Oct  4 09:52:29 10.0.0.20 c0
> Oct  4 09:52:29 10.0.0.20 74
> Oct  4 09:52:29 10.0.0.20 04
> Oct  4 09:52:29 10.0.0.20 0b
> Oct  4 09:52:29 10.0.0.20 eb
> Oct  4 09:52:29 10.0.0.20 fe
> Oct  4 09:52:29 10.0.0.20 8b
> Oct  4 09:52:29 10.0.0.20 54
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 0c
> Oct  4 09:52:29 10.0.0.20 8b
> Oct  4 09:52:29 10.0.0.20 42
> Oct  4 09:52:29 10.0.0.20 10
> Oct  4 09:52:29 10.0.0.20 8b
> Oct  4 09:52:29 10.0.0.20 54
> Oct  4 09:52:29 10.0.0.20 24
> Oct  4 09:52:29 10.0.0.20 10
> Oct  4 09:52:29 10.0.0.20 89
> Oct  4 09:52:29 10.0.0.20 42
> Oct  4 09:52:29 10.0.0.20 10
> Oct  4 09:52:29 10.0.0.20 0f
> Oct  4 09:52:29 10.0.0.20 ba
> Oct  4 09:52:29 10.0.0.20 2a
> Oct  4 09:52:29 10.0.0.20
> Oct  4 09:52:29 10.0.0.20 [174345.336513] EIP: [<c119803b>]
> Oct  4 09:52:29 10.0.0.20 gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:52:29 10.0.0.20  SS:ESP 0069:ec847d10
> Oct  4 09:52:29 10.0.0.20 [174345.336513] ---[ end trace 
> 12e6e134d9f4fe6d ]---
> Oct  4 09:52:29 10.0.0.20 [174345.336513] Kernel panic - not syncing: 
> Fatal exception in interrupt
> Oct  4 09:52:29 10.0.0.20 [174345.336513] Pid: 0, comm: swapper Tainted: 
> G      D    2.6.32-5-xen-686 #1
> Oct  4 09:52:29 10.0.0.20 [174345.336513] Call Trace:
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128c191>] ? panic+0x38/0xe4
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128e799>] ? 
> oops_end+0x91/0x9d
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009f21>] ? 
> do_invalid_op+0x0/0x75
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009f8d>] ? 
> do_invalid_op+0x6c/0x75
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1092fc1>] ? 
> __alloc_pages_nodemask+0xf3/0x4e0
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128de8b>] ? 
> error_code+0x73/0x78
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:52:29 10.0.0.20 [174345.336513]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> Oct  4 09:53:33 10.0.0.20 [174410.032507] BUG: soft lockup - CPU#1 stuck 
> for 61s! [swapper:0]
> Oct  4 09:53:33 10.0.0.20 [174410.032507] Modules linked in:
> Oct  4 09:53:33 10.0.0.20  netconsole
> Oct  4 09:53:33 10.0.0.20  configfs
> Oct  4 09:53:33 10.0.0.20  xt_tcpudp
> Oct  4 09:53:33 10.0.0.20  nf_conntrack_ipv4
> Oct  4 09:53:33 10.0.0.20  nf_defrag_ipv4
> Oct  4 09:53:33 10.0.0.20  xt_state
> Oct  4 09:53:33 10.0.0.20  nf_conntrack
> Oct  4 09:53:33 10.0.0.20  xt_physdev
> Oct  4 09:53:33 10.0.0.20  iptable_filter
> Oct  4 09:53:33 10.0.0.20  ip_tables
> Oct  4 09:53:33 10.0.0.20  x_tables
> Oct  4 09:53:33 10.0.0.20  bridge
> Oct  4 09:53:33 10.0.0.20  stp
> Oct  4 09:53:33 10.0.0.20  xen_evtchn
> Oct  4 09:53:33 10.0.0.20  xenfs
> Oct  4 09:53:33 10.0.0.20  nfsd
> Oct  4 09:53:33 10.0.0.20  exportfs
> Oct  4 09:53:33 10.0.0.20  nfs
> Oct  4 09:53:33 10.0.0.20  lockd
> Oct  4 09:53:33 10.0.0.20  fscache
> Oct  4 09:53:33 10.0.0.20  nfs_acl
> Oct  4 09:53:33 10.0.0.20  auth_rpcgss
> Oct  4 09:53:33 10.0.0.20  sunrpc
> Oct  4 09:53:33 10.0.0.20  loop
> Oct  4 09:53:33 10.0.0.20  snd_pcm
> Oct  4 09:53:33 10.0.0.20  snd_timer
> Oct  4 09:53:33 10.0.0.20  snd
> Oct  4 09:53:33 10.0.0.20  soundcore
> Oct  4 09:53:33 10.0.0.20  psmouse
> Oct  4 09:53:33 10.0.0.20  pl2303
> Oct  4 09:53:33 10.0.0.20  snd_page_alloc
> Oct  4 09:53:33 10.0.0.20  usbserial
> Oct  4 09:53:33 10.0.0.20  serio_raw
> Oct  4 09:53:33 10.0.0.20  pcspkr
> Oct  4 09:53:33 10.0.0.20  shpchp
> Oct  4 09:53:33 10.0.0.20  evdev
> Oct  4 09:53:33 10.0.0.20  dcdbas
> Oct  4 09:53:33 10.0.0.20  pci_hotplug
> Oct  4 09:53:33 10.0.0.20  i2c_piix4
> Oct  4 09:53:33 10.0.0.20  i2c_core
> Oct  4 09:53:33 10.0.0.20  processor
> Oct  4 09:53:33 10.0.0.20  acpi_processor
> Oct  4 09:53:33 10.0.0.20  button
> Oct  4 09:53:33 10.0.0.20  ext3
> Oct  4 09:53:33 10.0.0.20  jbd
> Oct  4 09:53:33 10.0.0.20  mbcache
> Oct  4 09:53:33 10.0.0.20  sg
> Oct  4 09:53:33 10.0.0.20  sr_mod
> Oct  4 09:53:33 10.0.0.20  cdrom
> Oct  4 09:53:33 10.0.0.20  sd_mod
> Oct  4 09:53:33 10.0.0.20  crc_t10dif
> Oct  4 09:53:33 10.0.0.20  ata_generic
> Oct  4 09:53:33 10.0.0.20  ohci_hcd
> Oct  4 09:53:33 10.0.0.20  pata_serverworks
> Oct  4 09:53:33 10.0.0.20  megaraid_mbox
> Oct  4 09:53:33 10.0.0.20  megaraid_mm
> Oct  4 09:53:33 10.0.0.20  tg3
> Oct  4 09:53:33 10.0.0.20  floppy
> Oct  4 09:53:33 10.0.0.20  aacraid
> Oct  4 09:53:33 10.0.0.20  libphy
> Oct  4 09:53:33 10.0.0.20  qla1280
> Oct  4 09:53:33 10.0.0.20  ehci_hcd
> Oct  4 09:53:33 10.0.0.20  libata
> Oct  4 09:53:33 10.0.0.20  usbcore
> Oct  4 09:53:33 10.0.0.20  nls_base
> Oct  4 09:53:33 10.0.0.20  thermal
> Oct  4 09:53:33 10.0.0.20  scsi_mod
> Oct  4 09:53:33 10.0.0.20  thermal_sys
> Oct  4 09:53:33 10.0.0.20  [last unloaded: scsi_wait_scan]
> Oct  4 09:53:33 10.0.0.20
> Oct  4 09:53:33 10.0.0.20 [174410.032507]
> Oct  4 09:53:33 10.0.0.20 [174410.032507] Pid: 0, comm: swapper Tainted: 
> G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
> Oct  4 09:53:33 10.0.0.20 [174410.032507] EIP: 0061:[<c1059e72>] EFLAGS: 
> 00000202 CPU: 1
> Oct  4 09:53:33 10.0.0.20 [174410.032507] EIP is at 
> smp_call_function_many+0xed/0x17c
> Oct  4 09:53:33 10.0.0.20 [174410.032507] EAX: c145a6dc EBX: 00000002 
> ECX: 00000003 EDX: 03cd9000
> Oct  4 09:53:33 10.0.0.20 [174410.032507] ESI: c51336dc EDI: 00000001 
> EBP: c13fa2b4 ESP: ec847ba0
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  DS: 007b ES: 007b FS: 00d8 
> GS: 00e0 SS: 0069
> Oct  4 09:53:33 10.0.0.20 [174410.032507] CR0: 8005003b CR2: 094c7808 
> CR3: 0a1c5000 CR4: 00000660
> Oct  4 09:53:33 10.0.0.20 [174410.032507] DR0: 00000000 DR1: 00000000 
> DR2: 00000000 DR3: 00000000
> Oct  4 09:53:33 10.0.0.20 [174410.032507] DR6: ffff0ff0 DR7: 00000400
> Oct  4 09:53:33 10.0.0.20 [174410.032507] Call Trace:
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1006d5c>] ? 
> stop_self+0x0/0x30
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1059f1a>] ? 
> smp_call_function+0x19/0x1f
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10036be>] ? 
> xen_reboot+0x14/0x28
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1003705>] ? 
> xen_panic_event+0xa/0xd
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128f990>] ? 
> notifier_call_chain+0x2a/0x47
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128f9c0>] ? 
> atomic_notifier_call_chain+0xc/0xf
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128c1af>] ? panic+0x56/0xe4
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128e799>] ? 
> oops_end+0x91/0x9d
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009f21>] ? 
> do_invalid_op+0x0/0x75
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009f8d>] ? 
> do_invalid_op+0x6c/0x75
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1092fc1>] ? 
> __alloc_pages_nodemask+0xf3/0x4e0
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128de8b>] ? 
> error_code+0x73/0x78
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:53:33 10.0.0.20 [174410.032507]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> Oct  4 09:54:39 10.0.0.20 [174475.532508] BUG: soft lockup - CPU#1 stuck 
> for 61s! [swapper:0]
> Oct  4 09:54:39 10.0.0.20 [174475.532508] Modules linked in:
> Oct  4 09:54:39 10.0.0.20  netconsole
> Oct  4 09:54:39 10.0.0.20  configfs
> Oct  4 09:54:39 10.0.0.20  xt_tcpudp
> Oct  4 09:54:39 10.0.0.20  nf_conntrack_ipv4
> Oct  4 09:54:39 10.0.0.20  nf_defrag_ipv4
> Oct  4 09:54:39 10.0.0.20  xt_state
> Oct  4 09:54:39 10.0.0.20  nf_conntrack
> Oct  4 09:54:39 10.0.0.20  xt_physdev
> Oct  4 09:54:39 10.0.0.20  iptable_filter
> Oct  4 09:54:39 10.0.0.20  ip_tables
> Oct  4 09:54:39 10.0.0.20  x_tables
> Oct  4 09:54:39 10.0.0.20  bridge
> Oct  4 09:54:39 10.0.0.20  stp
> Oct  4 09:54:39 10.0.0.20  xen_evtchn
> Oct  4 09:54:39 10.0.0.20  xenfs
> Oct  4 09:54:39 10.0.0.20  nfsd
> Oct  4 09:54:39 10.0.0.20  exportfs
> Oct  4 09:54:39 10.0.0.20  nfs
> Oct  4 09:54:39 10.0.0.20  lockd
> Oct  4 09:54:39 10.0.0.20  fscache
> Oct  4 09:54:39 10.0.0.20  nfs_acl
> Oct  4 09:54:39 10.0.0.20  auth_rpcgss
> Oct  4 09:54:39 10.0.0.20  sunrpc
> Oct  4 09:54:39 10.0.0.20  loop
> Oct  4 09:54:39 10.0.0.20  snd_pcm
> Oct  4 09:54:39 10.0.0.20  snd_timer
> Oct  4 09:54:39 10.0.0.20  snd
> Oct  4 09:54:39 10.0.0.20  soundcore
> Oct  4 09:54:39 10.0.0.20  psmouse
> Oct  4 09:54:39 10.0.0.20  pl2303
> Oct  4 09:54:39 10.0.0.20  snd_page_alloc
> Oct  4 09:54:39 10.0.0.20  usbserial
> Oct  4 09:54:39 10.0.0.20  serio_raw
> Oct  4 09:54:39 10.0.0.20  pcspkr
> Oct  4 09:54:39 10.0.0.20  shpchp
> Oct  4 09:54:39 10.0.0.20  evdev
> Oct  4 09:54:39 10.0.0.20  dcdbas
> Oct  4 09:54:39 10.0.0.20  pci_hotplug
> Oct  4 09:54:39 10.0.0.20  i2c_piix4
> Oct  4 09:54:39 10.0.0.20  i2c_core
> Oct  4 09:54:39 10.0.0.20  processor
> Oct  4 09:54:39 10.0.0.20  acpi_processor
> Oct  4 09:54:39 10.0.0.20  button
> Oct  4 09:54:39 10.0.0.20  ext3
> Oct  4 09:54:39 10.0.0.20  jbd
> Oct  4 09:54:39 10.0.0.20  mbcache
> Oct  4 09:54:39 10.0.0.20  sg
> Oct  4 09:54:39 10.0.0.20  sr_mod
> Oct  4 09:54:39 10.0.0.20  cdrom
> Oct  4 09:54:39 10.0.0.20  sd_mod
> Oct  4 09:54:39 10.0.0.20  crc_t10dif
> Oct  4 09:54:39 10.0.0.20  ata_generic
> Oct  4 09:54:39 10.0.0.20  ohci_hcd
> Oct  4 09:54:39 10.0.0.20  pata_serverworks
> Oct  4 09:54:39 10.0.0.20  megaraid_mbox
> Oct  4 09:54:39 10.0.0.20  megaraid_mm
> Oct  4 09:54:39 10.0.0.20  tg3
> Oct  4 09:54:39 10.0.0.20  floppy
> Oct  4 09:54:39 10.0.0.20  aacraid
> Oct  4 09:54:39 10.0.0.20  libphy
> Oct  4 09:54:39 10.0.0.20  qla1280
> Oct  4 09:54:39 10.0.0.20  ehci_hcd
> Oct  4 09:54:39 10.0.0.20  libata
> Oct  4 09:54:39 10.0.0.20  usbcore
> Oct  4 09:54:39 10.0.0.20  nls_base
> Oct  4 09:54:39 10.0.0.20  thermal
> Oct  4 09:54:39 10.0.0.20  scsi_mod
> Oct  4 09:54:39 10.0.0.20  thermal_sys
> Oct  4 09:54:39 10.0.0.20  [last unloaded: scsi_wait_scan]
> Oct  4 09:54:39 10.0.0.20
> Oct  4 09:54:39 10.0.0.20 [174475.532508]
> Oct  4 09:54:39 10.0.0.20 [174475.532508] Pid: 0, comm: swapper Tainted: 
> G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
> Oct  4 09:54:39 10.0.0.20 [174475.532508] EIP: 0061:[<c1059e6e>] EFLAGS: 
> 00000202 CPU: 1
> Oct  4 09:54:39 10.0.0.20 [174475.532508] EIP is at 
> smp_call_function_many+0xe9/0x17c
> Oct  4 09:54:39 10.0.0.20 [174475.532508] EAX: c145a6dc EBX: 00000002 
> ECX: 00000003 EDX: 03cd9000
> Oct  4 09:54:39 10.0.0.20 [174475.532508] ESI: c51336dc EDI: 00000001 
> EBP: c13fa2b4 ESP: ec847ba0
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  DS: 007b ES: 007b FS: 00d8 
> GS: 00e0 SS: 0069
> Oct  4 09:54:39 10.0.0.20 [174475.532508] CR0: 8005003b CR2: 094c7808 
> CR3: 0a1c5000 CR4: 00000660
> Oct  4 09:54:39 10.0.0.20 [174475.532508] DR0: 00000000 DR1: 00000000 
> DR2: 00000000 DR3: 00000000
> Oct  4 09:54:39 10.0.0.20 [174475.532508] DR6: ffff0ff0 DR7: 00000400
> Oct  4 09:54:39 10.0.0.20 [174475.532508] Call Trace:
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1006d5c>] ? 
> stop_self+0x0/0x30
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1059f1a>] ? 
> smp_call_function+0x19/0x1f
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10036be>] ? 
> xen_reboot+0x14/0x28
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1003705>] ? 
> xen_panic_event+0xa/0xd
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128f990>] ? 
> notifier_call_chain+0x2a/0x47
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128f9c0>] ? 
> atomic_notifier_call_chain+0xc/0xf
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128c1af>] ? panic+0x56/0xe4
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128e799>] ? 
> oops_end+0x91/0x9d
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009f21>] ? 
> do_invalid_op+0x0/0x75
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009f8d>] ? 
> do_invalid_op+0x6c/0x75
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1092fc1>] ? 
> __alloc_pages_nodemask+0xf3/0x4e0
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128de8b>] ? 
> error_code+0x73/0x78
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:54:39 10.0.0.20 [174475.532508]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> Oct  4 09:55:44 10.0.0.20 [174541.028507] BUG: soft lockup - CPU#1 stuck 
> for 61s! [swapper:0]
> Oct  4 09:55:44 10.0.0.20 [174541.028507] Modules linked in:
> Oct  4 09:55:44 10.0.0.20  netconsole
> Oct  4 09:55:44 10.0.0.20  configfs
> Oct  4 09:55:44 10.0.0.20  xt_tcpudp
> Oct  4 09:55:44 10.0.0.20  nf_conntrack_ipv4
> Oct  4 09:55:44 10.0.0.20  nf_defrag_ipv4
> Oct  4 09:55:44 10.0.0.20  xt_state
> Oct  4 09:55:44 10.0.0.20  nf_conntrack
> Oct  4 09:55:44 10.0.0.20  xt_physdev
> Oct  4 09:55:44 10.0.0.20  iptable_filter
> Oct  4 09:55:44 10.0.0.20  ip_tables
> Oct  4 09:55:44 10.0.0.20  x_tables
> Oct  4 09:55:44 10.0.0.20  bridge
> Oct  4 09:55:44 10.0.0.20  stp
> Oct  4 09:55:44 10.0.0.20  xen_evtchn
> Oct  4 09:55:44 10.0.0.20  xenfs
> Oct  4 09:55:44 10.0.0.20  nfsd
> Oct  4 09:55:44 10.0.0.20  exportfs
> Oct  4 09:55:44 10.0.0.20  nfs
> Oct  4 09:55:44 10.0.0.20  lockd
> Oct  4 09:55:44 10.0.0.20  fscache
> Oct  4 09:55:44 10.0.0.20  nfs_acl
> Oct  4 09:55:44 10.0.0.20  auth_rpcgss
> Oct  4 09:55:44 10.0.0.20  sunrpc
> Oct  4 09:55:44 10.0.0.20  loop
> Oct  4 09:55:44 10.0.0.20  snd_pcm
> Oct  4 09:55:44 10.0.0.20  snd_timer
> Oct  4 09:55:44 10.0.0.20  snd
> Oct  4 09:55:44 10.0.0.20  soundcore
> Oct  4 09:55:44 10.0.0.20  psmouse
> Oct  4 09:55:44 10.0.0.20  pl2303
> Oct  4 09:55:44 10.0.0.20  snd_page_alloc
> Oct  4 09:55:44 10.0.0.20  usbserial
> Oct  4 09:55:44 10.0.0.20  serio_raw
> Oct  4 09:55:44 10.0.0.20  pcspkr
> Oct  4 09:55:44 10.0.0.20  shpchp
> Oct  4 09:55:44 10.0.0.20  evdev
> Oct  4 09:55:44 10.0.0.20  dcdbas
> Oct  4 09:55:44 10.0.0.20  pci_hotplug
> Oct  4 09:55:44 10.0.0.20  i2c_piix4
> Oct  4 09:55:44 10.0.0.20  i2c_core
> Oct  4 09:55:44 10.0.0.20  processor
> Oct  4 09:55:44 10.0.0.20  acpi_processor
> Oct  4 09:55:44 10.0.0.20  button
> Oct  4 09:55:44 10.0.0.20  ext3
> Oct  4 09:55:44 10.0.0.20  jbd
> Oct  4 09:55:44 10.0.0.20  mbcache
> Oct  4 09:55:44 10.0.0.20  sg
> Oct  4 09:55:44 10.0.0.20  sr_mod
> Oct  4 09:55:44 10.0.0.20  cdrom
> Oct  4 09:55:44 10.0.0.20  sd_mod
> Oct  4 09:55:44 10.0.0.20  crc_t10dif
> Oct  4 09:55:44 10.0.0.20  ata_generic
> Oct  4 09:55:44 10.0.0.20  ohci_hcd
> Oct  4 09:55:44 10.0.0.20  pata_serverworks
> Oct  4 09:55:44 10.0.0.20  megaraid_mbox
> Oct  4 09:55:44 10.0.0.20  megaraid_mm
> Oct  4 09:55:44 10.0.0.20  tg3
> Oct  4 09:55:44 10.0.0.20  floppy
> Oct  4 09:55:44 10.0.0.20  aacraid
> Oct  4 09:55:44 10.0.0.20  libphy
> Oct  4 09:55:44 10.0.0.20  qla1280
> Oct  4 09:55:44 10.0.0.20  ehci_hcd
> Oct  4 09:55:44 10.0.0.20  libata
> Oct  4 09:55:44 10.0.0.20  usbcore
> Oct  4 09:55:44 10.0.0.20  nls_base
> Oct  4 09:55:44 10.0.0.20  thermal
> Oct  4 09:55:44 10.0.0.20  scsi_mod
> Oct  4 09:55:44 10.0.0.20  thermal_sys
> Oct  4 09:55:44 10.0.0.20  [last unloaded: scsi_wait_scan]
> Oct  4 09:55:44 10.0.0.20
> Oct  4 09:55:44 10.0.0.20 [174541.028507]
> Oct  4 09:55:44 10.0.0.20 [174541.028507] Pid: 0, comm: swapper Tainted: 
> G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
> Oct  4 09:55:44 10.0.0.20 [174541.028507] EIP: 0061:[<c1059e6e>] EFLAGS: 
> 00000202 CPU: 1
> Oct  4 09:55:44 10.0.0.20 [174541.028507] EIP is at 
> smp_call_function_many+0xe9/0x17c
> Oct  4 09:55:44 10.0.0.20 [174541.028507] EAX: c145a6dc EBX: 00000002 
> ECX: 00000003 EDX: 03cd9000
> Oct  4 09:55:44 10.0.0.20 [174541.028507] ESI: c51336dc EDI: 00000001 
> EBP: c13fa2b4 ESP: ec847ba0
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  DS: 007b ES: 007b FS: 00d8 
> GS: 00e0 SS: 0069
> Oct  4 09:55:44 10.0.0.20 [174541.028507] CR0: 8005003b CR2: 094c7808 
> CR3: 0a1c5000 CR4: 00000660
> Oct  4 09:55:44 10.0.0.20 [174541.028507] DR0: 00000000 DR1: 00000000 
> DR2: 00000000 DR3: 00000000
> Oct  4 09:55:44 10.0.0.20 [174541.028507] DR6: ffff0ff0 DR7: 00000400
> Oct  4 09:55:44 10.0.0.20 [174541.028507] Call Trace:
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1006d5c>] ? 
> stop_self+0x0/0x30
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1059f1a>] ? 
> smp_call_function+0x19/0x1f
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10036be>] ? 
> xen_reboot+0x14/0x28
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1003705>] ? 
> xen_panic_event+0xa/0xd
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128f990>] ? 
> notifier_call_chain+0x2a/0x47
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128f9c0>] ? 
> atomic_notifier_call_chain+0xc/0xf
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128c1af>] ? panic+0x56/0xe4
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128e799>] ? 
> oops_end+0x91/0x9d
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009f21>] ? 
> do_invalid_op+0x0/0x75
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009f8d>] ? 
> do_invalid_op+0x6c/0x75
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1092fc1>] ? 
> __alloc_pages_nodemask+0xf3/0x4e0
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128de8b>] ? 
> error_code+0x73/0x78
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:55:44 10.0.0.20 [174541.028507]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> Oct  4 09:56:50 10.0.0.20 [174606.528507] BUG: soft lockup - CPU#1 stuck 
> for 61s! [swapper:0]
> Oct  4 09:56:50 10.0.0.20 [174606.528507] Modules linked in:
> Oct  4 09:56:50 10.0.0.20  netconsole
> Oct  4 09:56:50 10.0.0.20  configfs
> Oct  4 09:56:50 10.0.0.20  xt_tcpudp
> Oct  4 09:56:50 10.0.0.20  nf_conntrack_ipv4
> Oct  4 09:56:50 10.0.0.20  nf_defrag_ipv4
> Oct  4 09:56:50 10.0.0.20  xt_state
> Oct  4 09:56:50 10.0.0.20  nf_conntrack
> Oct  4 09:56:50 10.0.0.20  xt_physdev
> Oct  4 09:56:50 10.0.0.20  iptable_filter
> Oct  4 09:56:50 10.0.0.20  ip_tables
> Oct  4 09:56:50 10.0.0.20  x_tables
> Oct  4 09:56:50 10.0.0.20  bridge
> Oct  4 09:56:50 10.0.0.20  stp
> Oct  4 09:56:50 10.0.0.20  xen_evtchn
> Oct  4 09:56:50 10.0.0.20  xenfs
> Oct  4 09:56:50 10.0.0.20  nfsd
> Oct  4 09:56:50 10.0.0.20  exportfs
> Oct  4 09:56:50 10.0.0.20  nfs
> Oct  4 09:56:50 10.0.0.20  lockd
> Oct  4 09:56:50 10.0.0.20  fscache
> Oct  4 09:56:50 10.0.0.20  nfs_acl
> Oct  4 09:56:50 10.0.0.20  auth_rpcgss
> Oct  4 09:56:50 10.0.0.20  sunrpc
> Oct  4 09:56:50 10.0.0.20  loop
> Oct  4 09:56:50 10.0.0.20  snd_pcm
> Oct  4 09:56:50 10.0.0.20  snd_timer
> Oct  4 09:56:50 10.0.0.20  snd
> Oct  4 09:56:50 10.0.0.20  soundcore
> Oct  4 09:56:50 10.0.0.20  psmouse
> Oct  4 09:56:50 10.0.0.20  pl2303
> Oct  4 09:56:50 10.0.0.20  snd_page_alloc
> Oct  4 09:56:50 10.0.0.20  usbserial
> Oct  4 09:56:50 10.0.0.20  serio_raw
> Oct  4 09:56:50 10.0.0.20  pcspkr
> Oct  4 09:56:50 10.0.0.20  shpchp
> Oct  4 09:56:50 10.0.0.20  evdev
> Oct  4 09:56:50 10.0.0.20  dcdbas
> Oct  4 09:56:50 10.0.0.20  pci_hotplug
> Oct  4 09:56:50 10.0.0.20  i2c_piix4
> Oct  4 09:56:50 10.0.0.20  i2c_core
> Oct  4 09:56:50 10.0.0.20  processor
> Oct  4 09:56:50 10.0.0.20  acpi_processor
> Oct  4 09:56:50 10.0.0.20  button
> Oct  4 09:56:50 10.0.0.20  ext3
> Oct  4 09:56:50 10.0.0.20  jbd
> Oct  4 09:56:50 10.0.0.20  mbcache
> Oct  4 09:56:50 10.0.0.20  sg
> Oct  4 09:56:50 10.0.0.20  sr_mod
> Oct  4 09:56:50 10.0.0.20  cdrom
> Oct  4 09:56:50 10.0.0.20  sd_mod
> Oct  4 09:56:50 10.0.0.20  crc_t10dif
> Oct  4 09:56:50 10.0.0.20  ata_generic
> Oct  4 09:56:50 10.0.0.20  ohci_hcd
> Oct  4 09:56:50 10.0.0.20  pata_serverworks
> Oct  4 09:56:50 10.0.0.20  megaraid_mbox
> Oct  4 09:56:50 10.0.0.20  megaraid_mm
> Oct  4 09:56:50 10.0.0.20  tg3
> Oct  4 09:56:50 10.0.0.20  floppy
> Oct  4 09:56:50 10.0.0.20  aacraid
> Oct  4 09:56:50 10.0.0.20  libphy
> Oct  4 09:56:50 10.0.0.20  qla1280
> Oct  4 09:56:50 10.0.0.20  ehci_hcd
> Oct  4 09:56:50 10.0.0.20  libata
> Oct  4 09:56:50 10.0.0.20  usbcore
> Oct  4 09:56:50 10.0.0.20  nls_base
> Oct  4 09:56:50 10.0.0.20  thermal
> Oct  4 09:56:50 10.0.0.20  scsi_mod
> Oct  4 09:56:50 10.0.0.20  thermal_sys
> Oct  4 09:56:50 10.0.0.20  [last unloaded: scsi_wait_scan]
> Oct  4 09:56:50 10.0.0.20
> Oct  4 09:56:50 10.0.0.20 [174606.528507]
> Oct  4 09:56:50 10.0.0.20 [174606.528507] Pid: 0, comm: swapper Tainted: 
> G      D    (2.6.32-5-xen-686 #1) PowerEdge 2650
> Oct  4 09:56:50 10.0.0.20 [174606.528507] EIP: 0061:[<c1059e6e>] EFLAGS: 
> 00000202 CPU: 1
> Oct  4 09:56:50 10.0.0.20 [174606.528507] EIP is at 
> smp_call_function_many+0xe9/0x17c
> Oct  4 09:56:50 10.0.0.20 [174606.528507] EAX: c145a6dc EBX: 00000002 
> ECX: 00000003 EDX: 03cd9000
> Oct  4 09:56:50 10.0.0.20 [174606.528507] ESI: c51336dc EDI: 00000001 
> EBP: c13fa2b4 ESP: ec847ba0
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  DS: 007b ES: 007b FS: 00d8 
> GS: 00e0 SS: 0069
> Oct  4 09:56:50 10.0.0.20 [174606.528507] CR0: 8005003b CR2: 094c7808 
> CR3: 0a1c5000 CR4: 00000660
> Oct  4 09:56:50 10.0.0.20 [174606.528507] DR0: 00000000 DR1: 00000000 
> DR2: 00000000 DR3: 00000000
> Oct  4 09:56:50 10.0.0.20 [174606.528507] DR6: ffff0ff0 DR7: 00000400
> Oct  4 09:56:50 10.0.0.20 [174606.528507] Call Trace:
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1006d5c>] ? 
> stop_self+0x0/0x30
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1059f1a>] ? 
> smp_call_function+0x19/0x1f
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10036be>] ? 
> xen_reboot+0x14/0x28
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1003705>] ? 
> xen_panic_event+0xa/0xd
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128f990>] ? 
> notifier_call_chain+0x2a/0x47
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128f9c0>] ? 
> atomic_notifier_call_chain+0xc/0xf
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128c1af>] ? panic+0x56/0xe4
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128e799>] ? 
> oops_end+0x91/0x9d
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009f21>] ? 
> do_invalid_op+0x0/0x75
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009f8d>] ? 
> do_invalid_op+0x6c/0x75
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1092fc1>] ? 
> __alloc_pages_nodemask+0xf3/0x4e0
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128de8b>] ? 
> error_code+0x73/0x78
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c119803b>] ? 
> gnttab_copy_grant_page+0x17d/0x22c
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c11a49ca>] ? 
> net_tx_action+0x1c8/0xeb1
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10211e3>] ? 
> pvclock_clocksource_read+0xf9/0x10f
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c113d59e>] ? 
> cpumask_next_and+0x23/0x33
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c102f8c8>] ? 
> find_busiest_group+0x2e9/0x6e6
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1034131>] ? 
> rebalance_domains+0x149/0x3e1
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1005fb8>] ? 
> xen_force_evtchn_callback+0xc/0x10
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066e0>] ? 
> check_events+0x8/0xc
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10066d7>] ? 
> xen_restore_fl_direct_end+0x0/0x1
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c128dca1>] ? 
> _spin_unlock_irqrestore+0xd/0xf
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103b17e>] ? 
> tasklet_action+0x67/0xad
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c2e0>] ? 
> __do_softirq+0xaa/0x151
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c3b8>] ? 
> do_softirq+0x31/0x3c
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c103c48e>] ? 
> irq_exit+0x26/0x58
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1198c15>] ? 
> xen_evtchn_do_upcall+0x22/0x2c
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1009abf>] ? 
> xen_do_upcall+0x7/0xc
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10023a7>] ? 
> hypercall_page+0x3a7/0x1001
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1006039>] ? 
> xen_safe_halt+0xf/0x1b
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c1004137>] ? 
> xen_idle+0x23/0x30
> Oct  4 09:56:50 10.0.0.20 [174606.528507]  [<c10080a8>] ? 
> cpu_idle+0x89/0xa5
> 
> 
> 
> 

-- 
Ian Campbell
Current Noise: Slayer - Born Of Fire

If at first you don't succeed, quit; don't be a nut about success.





Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 09:57:08 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ian Campbell <ijc@hellion.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 09:57:08 GMT) Full text and rfc822 format available.

Message #17 received at 599089@bugs.debian.org (full text, mbox):

From: Ian Campbell <ijc@hellion.org.uk>
To: Jason Kendall <jakendall@gmail.com>
Cc: 599089@bugs.debian.org, Jeremy Fitzhardinge <jeremy@goop.org>, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 10:52:28 +0100
On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
> 
> In addition to the kernel logging of the error I get this from the
> hypervisor:
> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
> od=0000000000000000, caf=180000000000000, taf=0000000000000000
> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
> (XEN) mm.c:3621:d0 Could not get page for mach->phys update

Adding a bit more logging to the kernel I get:
gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
(XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
(XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
(XEN) mm.c:3621:d0 Could not get page for mach->phys update

Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
hypervisor!

The following fixes it for me.

From: Ian Campbell <ian.campbell@citrix.com>
Subject: xen: grant table: do not truncate machine address on gnttab_copy_grant_page

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>

--- a/drivers/xen/grant-table.c
+++ b/drivers/xen/grant-table.c
@@ -578,7 +578,7 @@ int gnttab_copy_grant_page(grant_ref_t ref, struct page **pagep)
 	if (!xen_feature(XENFEAT_auto_translated_physmap)) {
 		set_phys_to_machine(page_to_pfn(new_page), INVALID_P2M_ENTRY);
 
-		mmu.ptr = (new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
+		mmu.ptr = ((u64)new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
 		mmu.val = pfn;
 		err = HYPERVISOR_mmu_update(&mmu, 1, NULL, DOMID_SELF);
 		BUG_ON(err);

-- 
Ian Campbell
Current Noise: Akercocke - Son Of The Morning

"I'd love to go out with you, but the man on television told me to stay tuned."





Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 13:36:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Jason Kendall <jakendall@gmail.com>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 13:36:03 GMT) Full text and rfc822 format available.

Message #22 received at 599089@bugs.debian.org (full text, mbox):

From: Jason Kendall <jakendall@gmail.com>
To: Ian Campbell <ijc@hellion.org.uk>
Cc: 599089@bugs.debian.org, Jeremy Fitzhardinge <jeremy@goop.org>, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 09:34:15 -0400
Thats great Ian;

I'll test the patch later today or tomorrow and get you a confirmation.

Regards,
Jason


On 10-10-05 05:52 AM, Ian Campbell wrote:
> On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
>    
>> In addition to the kernel logging of the error I get this from the
>> hypervisor:
>> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
>> od=0000000000000000, caf=180000000000000, taf=0000000000000000
>> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>>      
> Adding a bit more logging to the kernel I get:
> gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
> gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
> (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
> (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>
> Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
> hypervisor!
>
> The following fixes it for me.
>
> From: Ian Campbell<ian.campbell@citrix.com>
> Subject: xen: grant table: do not truncate machine address on gnttab_copy_grant_page
>
> Signed-off-by: Ian Campbell<ian.campbell@citrix.com>
>
> --- a/drivers/xen/grant-table.c
> +++ b/drivers/xen/grant-table.c
> @@ -578,7 +578,7 @@ int gnttab_copy_grant_page(grant_ref_t ref, struct page **pagep)
>   	if (!xen_feature(XENFEAT_auto_translated_physmap)) {
>   		set_phys_to_machine(page_to_pfn(new_page), INVALID_P2M_ENTRY);
>
> -		mmu.ptr = (new_mfn<<  PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
> +		mmu.ptr = ((u64)new_mfn<<  PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
>   		mmu.val = pfn;
>   		err = HYPERVISOR_mmu_update(&mmu, 1, NULL, DOMID_SELF);
>   		BUG_ON(err);
>
>    




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 17:03:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Jeremy Fitzhardinge <jeremy@goop.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 17:03:02 GMT) Full text and rfc822 format available.

Message #27 received at 599089@bugs.debian.org (full text, mbox):

From: Jeremy Fitzhardinge <jeremy@goop.org>
To: Ian Campbell <ijc@hellion.org.uk>
Cc: Jason Kendall <jakendall@gmail.com>, 599089@bugs.debian.org, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 09:54:34 -0700
 On 10/05/2010 02:52 AM, Ian Campbell wrote:
> On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
>> In addition to the kernel logging of the error I get this from the
>> hypervisor:
>> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
>> od=0000000000000000, caf=180000000000000, taf=0000000000000000
>> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
> Adding a bit more logging to the kernel I get:
> gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
> gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
> (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
> (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>
> Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
> hypervisor!

Oy, more of these.  It might be better to use PFN_PHYS().

    J

> The following fixes it for me.
>
> From: Ian Campbell <ian.campbell@citrix.com>
> Subject: xen: grant table: do not truncate machine address on gnttab_copy_grant_page
>
> Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
>
> --- a/drivers/xen/grant-table.c
> +++ b/drivers/xen/grant-table.c
> @@ -578,7 +578,7 @@ int gnttab_copy_grant_page(grant_ref_t ref, struct page **pagep)
>  	if (!xen_feature(XENFEAT_auto_translated_physmap)) {
>  		set_phys_to_machine(page_to_pfn(new_page), INVALID_P2M_ENTRY);
>  
> -		mmu.ptr = (new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
> +		mmu.ptr = ((u64)new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
>  		mmu.val = pfn;
>  		err = HYPERVISOR_mmu_update(&mmu, 1, NULL, DOMID_SELF);
>  		BUG_ON(err);
>





Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 18:27:09 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ian Campbell <ijc@hellion.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 18:27:09 GMT) Full text and rfc822 format available.

Message #32 received at 599089@bugs.debian.org (full text, mbox):

From: Ian Campbell <ijc@hellion.org.uk>
To: Jeremy Fitzhardinge <jeremy@goop.org>
Cc: Jason Kendall <jakendall@gmail.com>, 599089@bugs.debian.org, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 19:22:47 +0100
[Message part 1 (text/plain, inline)]
On Tue, 2010-10-05 at 09:54 -0700, Jeremy Fitzhardinge wrote: 
> On 10/05/2010 02:52 AM, Ian Campbell wrote:
> > On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
> >> In addition to the kernel logging of the error I get this from the
> >> hypervisor:
> >> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
> >> od=0000000000000000, caf=180000000000000, taf=0000000000000000
> >> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
> >> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
> > Adding a bit more logging to the kernel I get:
> > gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
> > gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
> > (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
> > (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
> > (XEN) mm.c:3621:d0 Could not get page for mach->phys update
> >
> > Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
> > hypervisor!
> 
> Oy, more of these.  It might be better to use PFN_PHYS().

I thought there ought to be a helper but couldn't find one, PFN_PHYS
sounds like a good bet, unless we want to alias it as MFN_MACH or
something?


> J
> 
> > The following fixes it for me.
> >
> > From: Ian Campbell <ian.campbell@citrix.com>
> > Subject: xen: grant table: do not truncate machine address on gnttab_copy_grant_page
> >
> > Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
> >
> > --- a/drivers/xen/grant-table.c
> > +++ b/drivers/xen/grant-table.c
> > @@ -578,7 +578,7 @@ int gnttab_copy_grant_page(grant_ref_t ref, struct page **pagep)
> >  	if (!xen_feature(XENFEAT_auto_translated_physmap)) {
> >  		set_phys_to_machine(page_to_pfn(new_page), INVALID_P2M_ENTRY);
> >  
> > -		mmu.ptr = (new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
> > +		mmu.ptr = ((u64)new_mfn << PAGE_SHIFT) | MMU_MACHPHYS_UPDATE;
> >  		mmu.val = pfn;
> >  		err = HYPERVISOR_mmu_update(&mmu, 1, NULL, DOMID_SELF);
> >  		BUG_ON(err);
> >
> 
> 

-- 
Ian Campbell

"Not Hercules could have knock'd out his brains, for he had none."
		-- Shakespeare
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Tue, 05 Oct 2010 22:42:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to Jeremy Fitzhardinge <jeremy@goop.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 05 Oct 2010 22:42:05 GMT) Full text and rfc822 format available.

Message #37 received at 599089@bugs.debian.org (full text, mbox):

From: Jeremy Fitzhardinge <jeremy@goop.org>
To: Ian Campbell <ijc@hellion.org.uk>
Cc: Jason Kendall <jakendall@gmail.com>, 599089@bugs.debian.org, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 15:39:23 -0700
 On 10/05/2010 11:22 AM, Ian Campbell wrote:
> On Tue, 2010-10-05 at 09:54 -0700, Jeremy Fitzhardinge wrote: 
>> On 10/05/2010 02:52 AM, Ian Campbell wrote:
>>> On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
>>>> In addition to the kernel logging of the error I get this from the
>>>> hypervisor:
>>>> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
>>>> od=0000000000000000, caf=180000000000000, taf=0000000000000000
>>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
>>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>>> Adding a bit more logging to the kernel I get:
>>> gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
>>> gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
>>> (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>>>
>>> Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
>>> hypervisor!
>> Oy, more of these.  It might be better to use PFN_PHYS().
> I thought there ought to be a helper but couldn't find one, PFN_PHYS
> sounds like a good bet, unless we want to alias it as MFN_MACH or
> something?

Doesn't really seem worth it, unless phys_addr_t ends up not being large
enough for a machine address.  But I think we rely on that pretty
heavily anyway.

I've committed it with that change.

    J




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Wed, 06 Oct 2010 02:15:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Jason Kendall <jakendall@gmail.com>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Wed, 06 Oct 2010 02:15:03 GMT) Full text and rfc822 format available.

Message #42 received at 599089@bugs.debian.org (full text, mbox):

From: Jason Kendall <jakendall@gmail.com>
To: Jeremy Fitzhardinge <jeremy@goop.org>
Cc: Ian Campbell <ijc@hellion.org.uk>, 599089@bugs.debian.org, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Tue, 05 Oct 2010 22:14:07 -0400
Where do you guys commit? I didn't see it on the kernel git tree, and 
can't find a debian one.

Would this happen to make it into Squeeze soon? ETA?

Save me the trouble of a recompile :)

Cheers,
Jay


On 10-10-05 06:39 PM, Jeremy Fitzhardinge wrote:
>   On 10/05/2010 11:22 AM, Ian Campbell wrote:
>    
>> On Tue, 2010-10-05 at 09:54 -0700, Jeremy Fitzhardinge wrote:
>>      
>>> On 10/05/2010 02:52 AM, Ian Campbell wrote:
>>>        
>>>> On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
>>>>          
>>>>> In addition to the kernel logging of the error I get this from the
>>>>> hypervisor:
>>>>> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
>>>>> od=0000000000000000, caf=180000000000000, taf=0000000000000000
>>>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
>>>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>>>>>            
>>>> Adding a bit more logging to the kernel I get:
>>>> gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
>>>> gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
>>>> (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
>>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
>>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
>>>>
>>>> Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
>>>> hypervisor!
>>>>          
>>> Oy, more of these.  It might be better to use PFN_PHYS().
>>>        
>> I thought there ought to be a helper but couldn't find one, PFN_PHYS
>> sounds like a good bet, unless we want to alias it as MFN_MACH or
>> something?
>>      
> Doesn't really seem worth it, unless phys_addr_t ends up not being large
> enough for a machine address.  But I think we rely on that pretty
> heavily anyway.
>
> I've committed it with that change.
>
>      J
>    




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#599089; Package linux-2.6. (Wed, 06 Oct 2010 09:24:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ian Campbell <ijc@hellion.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Wed, 06 Oct 2010 09:24:03 GMT) Full text and rfc822 format available.

Message #47 received at 599089@bugs.debian.org (full text, mbox):

From: Ian Campbell <ijc@hellion.org.uk>
To: Jason Kendall <jakendall@gmail.com>
Cc: Jeremy Fitzhardinge <jeremy@goop.org>, 599089@bugs.debian.org, xen-devel <xen-devel@lists.xensource.com>, Arnd Hannemann <hannemann@nets.rwth-aachen.de>
Subject: Re: Bug#599089: linux-image-2.6.32-5-xen-686: Kernel Panics when using NFS from DomU to Dom0
Date: Wed, 06 Oct 2010 10:21:45 +0100
On Tue, 2010-10-05 at 22:14 -0400, Jason Kendall wrote:
> Where do you guys commit? I didn't see it on the kernel git tree, and 
> can't find a debian one.

Jeremy is the upstream xen kernel maintainer so he has put it in his
tree at git://git.kernel.org/pub/scm/linux/kernel/git/jeremy/xen.git
specifically
http://git.kernel.org/?p=linux/kernel/git/jeremy/xen.git;a=commit;h=7ed8586dd2ba2340a28a5d3d21f3f531a5bd30f8

I'm just about to pull it into the Debian kernel SVN
svn://svn.debian.org/kernel/dists/trunk/linux-2.6. From there it will go
into unstable/sid whenever 2.6.32-25 is uploaded and then it will
propagate to testing/squeeze some time after that in the usual way.

However once it is in unstable there should be nothing to stop you
installing the package on a squeeze system.

I don't control the upload to sid schedule I'm afraid so I can't really
say when it will happen. Perhaps someone on debian-kernel will chime in.

Ian.

> Would this happen to make it into Squeeze soon? ETA?
> 
> Save me the trouble of a recompile :)
> 
> Cheers,
> Jay
> 
> 
> On 10-10-05 06:39 PM, Jeremy Fitzhardinge wrote:
> >   On 10/05/2010 11:22 AM, Ian Campbell wrote:
> >    
> >> On Tue, 2010-10-05 at 09:54 -0700, Jeremy Fitzhardinge wrote:
> >>      
> >>> On 10/05/2010 02:52 AM, Ian Campbell wrote:
> >>>        
> >>>> On Tue, 2010-10-05 at 10:47 +0100, Ian Campbell wrote:
> >>>>          
> >>>>> In addition to the kernel logging of the error I get this from the
> >>>>> hypervisor:
> >>>>> (XEN) mm.c:2062:d0 Error pfn 16d99: rd=ffff83011fefa000,
> >>>>> od=0000000000000000, caf=180000000000000, taf=0000000000000000
> >>>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 16d99
> >>>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
> >>>>>            
> >>>> Adding a bit more logging to the kernel I get:
> >>>> gnttb_copy_grant_page old c22ebcd8 P:0x1ec8e M:0xc499d F:0x41000000
> >>>> gnttb_copy_grant_page new c2324ce0 P:0x1fe18 M:0x11cd32 F:0x40000000
> >>>> (XEN) mm.c:2062:d0 Error pfn 1cd32: rd=ffff83011fefa000, od=0000000000000000, caf=180000000000000, taf=0000000000000000
> >>>> (XEN) mm.c:658:d0 Could not get page ref for pfn 1cd32
> >>>> (XEN) mm.c:3621:d0 Could not get page for mach->phys update
> >>>>
> >>>> Notice how MFN 0x11cd32 has become 0x1cd32 by the time it gets to the
> >>>> hypervisor!
> >>>>          
> >>> Oy, more of these.  It might be better to use PFN_PHYS().
> >>>        
> >> I thought there ought to be a helper but couldn't find one, PFN_PHYS
> >> sounds like a good bet, unless we want to alias it as MFN_MACH or
> >> something?
> >>      
> > Doesn't really seem worth it, unless phys_addr_t ends up not being large
> > enough for a machine address.  But I think we rely on that pretty
> > heavily anyway.
> >
> > I've committed it with that change.
> >
> >      J
> >    
> 

-- 
Ian Campbell

Friendships last when each friend thinks he has a slight superiority
over the other.
		-- Honore DeBalzac





Added tag(s) pending. Request was from Ian Campbell <ijc-guest@alioth.debian.org> to control@bugs.debian.org. (Wed, 06 Oct 2010 09:33:08 GMT) Full text and rfc822 format available.

Reply sent to dann frazier <dannf@debian.org>:
You have taken responsibility. (Fri, 15 Oct 2010 00:15:19 GMT) Full text and rfc822 format available.

Notification sent to Jason Kendall <jakendall@gmail.com>:
Bug acknowledged by developer. (Fri, 15 Oct 2010 00:15:19 GMT) Full text and rfc822 format available.

Message #54 received at 599089-close@bugs.debian.org (full text, mbox):

From: dann frazier <dannf@debian.org>
To: 599089-close@bugs.debian.org
Subject: Bug#599089: fixed in linux-2.6 2.6.32-25
Date: Fri, 15 Oct 2010 00:12:26 +0000
Source: linux-2.6
Source-Version: 2.6.32-25

We believe that the bug you reported is fixed in the latest version of
linux-2.6, which is due to be installed in the Debian FTP archive:

firmware-linux-free_2.6.32-25_all.deb
  to main/l/linux-2.6/firmware-linux-free_2.6.32-25_all.deb
linux-2.6_2.6.32-25.diff.gz
  to main/l/linux-2.6/linux-2.6_2.6.32-25.diff.gz
linux-2.6_2.6.32-25.dsc
  to main/l/linux-2.6/linux-2.6_2.6.32-25.dsc
linux-base_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-base_2.6.32-25_all.deb
linux-doc-2.6.32_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-doc-2.6.32_2.6.32-25_all.deb
linux-headers-2.6.32-5-486_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-486_2.6.32-25_i386.deb
linux-headers-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
linux-headers-2.6.32-5-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-686_2.6.32-25_i386.deb
linux-headers-2.6.32-5-all-i386_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-all-i386_2.6.32-25_i386.deb
linux-headers-2.6.32-5-all_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-all_2.6.32-25_i386.deb
linux-headers-2.6.32-5-amd64_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-amd64_2.6.32-25_i386.deb
linux-headers-2.6.32-5-common-openvz_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-common-openvz_2.6.32-25_i386.deb
linux-headers-2.6.32-5-common-vserver_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-common-vserver_2.6.32-25_i386.deb
linux-headers-2.6.32-5-common-xen_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-common-xen_2.6.32-25_i386.deb
linux-headers-2.6.32-5-common_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-common_2.6.32-25_i386.deb
linux-headers-2.6.32-5-openvz-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-openvz-686_2.6.32-25_i386.deb
linux-headers-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
linux-headers-2.6.32-5-vserver-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-vserver-686_2.6.32-25_i386.deb
linux-headers-2.6.32-5-xen-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-headers-2.6.32-5-xen-686_2.6.32-25_i386.deb
linux-image-2.6.32-5-486_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-486_2.6.32-25_i386.deb
linux-image-2.6.32-5-686-bigmem-dbg_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-686-bigmem-dbg_2.6.32-25_i386.deb
linux-image-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
linux-image-2.6.32-5-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-686_2.6.32-25_i386.deb
linux-image-2.6.32-5-amd64_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-amd64_2.6.32-25_i386.deb
linux-image-2.6.32-5-openvz-686-dbg_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-openvz-686-dbg_2.6.32-25_i386.deb
linux-image-2.6.32-5-openvz-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-openvz-686_2.6.32-25_i386.deb
linux-image-2.6.32-5-vserver-686-bigmem-dbg_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-vserver-686-bigmem-dbg_2.6.32-25_i386.deb
linux-image-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
linux-image-2.6.32-5-vserver-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-vserver-686_2.6.32-25_i386.deb
linux-image-2.6.32-5-xen-686-dbg_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-xen-686-dbg_2.6.32-25_i386.deb
linux-image-2.6.32-5-xen-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-image-2.6.32-5-xen-686_2.6.32-25_i386.deb
linux-libc-dev_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-libc-dev_2.6.32-25_i386.deb
linux-manual-2.6.32_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-manual-2.6.32_2.6.32-25_all.deb
linux-patch-debian-2.6.32_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-patch-debian-2.6.32_2.6.32-25_all.deb
linux-source-2.6.32_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-source-2.6.32_2.6.32-25_all.deb
linux-support-2.6.32-5_2.6.32-25_all.deb
  to main/l/linux-2.6/linux-support-2.6.32-5_2.6.32-25_all.deb
linux-tools-2.6.32_2.6.32-25_i386.deb
  to main/l/linux-2.6/linux-tools-2.6.32_2.6.32-25_i386.deb
xen-linux-system-2.6.32-5-xen-686_2.6.32-25_i386.deb
  to main/l/linux-2.6/xen-linux-system-2.6.32-5-xen-686_2.6.32-25_i386.deb



A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 599089@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
dann frazier <dannf@debian.org> (supplier of updated linux-2.6 package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Format: 1.8
Date: Thu, 14 Oct 2010 01:08:05 -0600
Source: linux-2.6
Binary: linux-tools-2.6.32 linux-source-2.6.32 linux-doc-2.6.32 linux-manual-2.6.32 linux-patch-debian-2.6.32 firmware-linux-free linux-support-2.6.32-5 linux-base linux-libc-dev linux-headers-2.6.32-5-all linux-headers-2.6.32-5-all-alpha linux-headers-2.6.32-5-common linux-image-2.6.32-5-alpha-generic linux-headers-2.6.32-5-alpha-generic linux-image-2.6.32-5-alpha-smp linux-headers-2.6.32-5-alpha-smp linux-image-2.6.32-5-alpha-legacy linux-headers-2.6.32-5-alpha-legacy linux-headers-2.6.32-5-all-amd64 linux-image-2.6.32-5-amd64 linux-headers-2.6.32-5-amd64 linux-image-2.6.32-5-amd64-dbg linux-headers-2.6.32-5-common-openvz linux-image-2.6.32-5-openvz-amd64 linux-headers-2.6.32-5-openvz-amd64 linux-image-2.6.32-5-openvz-amd64-dbg linux-headers-2.6.32-5-common-vserver linux-image-2.6.32-5-vserver-amd64 linux-headers-2.6.32-5-vserver-amd64 linux-image-2.6.32-5-vserver-amd64-dbg linux-headers-2.6.32-5-common-xen linux-image-2.6.32-5-xen-amd64 linux-headers-2.6.32-5-xen-amd64
 linux-image-2.6.32-5-xen-amd64-dbg xen-linux-system-2.6.32-5-xen-amd64 linux-headers-2.6.32-5-all-armel linux-image-2.6.32-5-iop32x linux-headers-2.6.32-5-iop32x linux-image-2.6.32-5-ixp4xx linux-headers-2.6.32-5-ixp4xx linux-image-2.6.32-5-kirkwood linux-headers-2.6.32-5-kirkwood linux-image-2.6.32-5-orion5x linux-headers-2.6.32-5-orion5x linux-image-2.6.32-5-versatile linux-headers-2.6.32-5-versatile linux-headers-2.6.32-5-all-hppa linux-image-2.6.32-5-parisc linux-headers-2.6.32-5-parisc linux-image-2.6.32-5-parisc-smp linux-headers-2.6.32-5-parisc-smp linux-image-2.6.32-5-parisc64 linux-headers-2.6.32-5-parisc64 linux-image-2.6.32-5-parisc64-smp linux-headers-2.6.32-5-parisc64-smp linux-headers-2.6.32-5-all-i386 linux-image-2.6.32-5-486 linux-headers-2.6.32-5-486 linux-image-2.6.32-5-686 linux-headers-2.6.32-5-686 linux-image-2.6.32-5-686-bigmem linux-headers-2.6.32-5-686-bigmem linux-image-2.6.32-5-686-bigmem-dbg linux-image-2.6.32-5-openvz-686
 linux-headers-2.6.32-5-openvz-686 linux-image-2.6.32-5-openvz-686-dbg linux-image-2.6.32-5-vserver-686 linux-headers-2.6.32-5-vserver-686 linux-image-2.6.32-5-vserver-686-bigmem linux-headers-2.6.32-5-vserver-686-bigmem linux-image-2.6.32-5-vserver-686-bigmem-dbg linux-image-2.6.32-5-xen-686 linux-headers-2.6.32-5-xen-686 linux-image-2.6.32-5-xen-686-dbg xen-linux-system-2.6.32-5-xen-686 linux-headers-2.6.32-5-all-ia64 linux-image-2.6.32-5-itanium linux-headers-2.6.32-5-itanium linux-image-2.6.32-5-mckinley linux-headers-2.6.32-5-mckinley linux-image-2.6.32-5-vserver-itanium linux-headers-2.6.32-5-vserver-itanium linux-image-2.6.32-5-vserver-mckinley linux-headers-2.6.32-5-vserver-mckinley linux-headers-2.6.32-5-all-m68k linux-image-2.6.32-5-amiga linux-headers-2.6.32-5-amiga linux-image-2.6.32-5-atari linux-headers-2.6.32-5-atari linux-image-2.6.32-5-bvme6000 linux-headers-2.6.32-5-bvme6000 linux-image-2.6.32-5-mac linux-headers-2.6.32-5-mac
 linux-image-2.6.32-5-mvme147 linux-headers-2.6.32-5-mvme147 linux-image-2.6.32-5-mvme16x linux-headers-2.6.32-5-mvme16x linux-headers-2.6.32-5-all-mips linux-image-2.6.32-5-r4k-ip22 linux-headers-2.6.32-5-r4k-ip22 linux-image-2.6.32-5-r5k-ip32 linux-headers-2.6.32-5-r5k-ip32 linux-image-2.6.32-5-sb1-bcm91250a linux-headers-2.6.32-5-sb1-bcm91250a linux-image-2.6.32-5-sb1a-bcm91480b linux-headers-2.6.32-5-sb1a-bcm91480b linux-image-2.6.32-5-4kc-malta linux-headers-2.6.32-5-4kc-malta linux-image-2.6.32-5-5kc-malta linux-headers-2.6.32-5-5kc-malta linux-headers-2.6.32-5-all-mipsel linux-image-2.6.32-5-r5k-cobalt linux-headers-2.6.32-5-r5k-cobalt linux-headers-2.6.32-5-all-powerpc linux-image-2.6.32-5-powerpc linux-headers-2.6.32-5-powerpc linux-image-2.6.32-5-powerpc-smp linux-headers-2.6.32-5-powerpc-smp linux-image-2.6.32-5-powerpc64 linux-headers-2.6.32-5-powerpc64 linux-image-2.6.32-5-vserver-powerpc linux-headers-2.6.32-5-vserver-powerpc
 linux-image-2.6.32-5-vserver-powerpc64 linux-headers-2.6.32-5-vserver-powerpc64 linux-headers-2.6.32-5-all-s390 linux-image-2.6.32-5-s390x linux-headers-2.6.32-5-s390x linux-image-2.6.32-5-s390x-tape linux-image-2.6.32-5-vserver-s390x linux-headers-2.6.32-5-vserver-s390x linux-headers-2.6.32-5-all-sh4 linux-image-2.6.32-5-sh7751r linux-headers-2.6.32-5-sh7751r linux-image-2.6.32-5-sh7785lcr linux-headers-2.6.32-5-sh7785lcr linux-headers-2.6.32-5-all-sparc linux-image-2.6.32-5-sparc64 linux-headers-2.6.32-5-sparc64 linux-image-2.6.32-5-sparc64-smp linux-headers-2.6.32-5-sparc64-smp linux-image-2.6.32-5-vserver-sparc64 linux-headers-2.6.32-5-vserver-sparc64
 linux-headers-2.6.32-5-all-sparc64
Architecture: source all i386
Version: 2.6.32-25
Distribution: unstable
Urgency: high
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Changed-By: dann frazier <dannf@debian.org>
Description: 
 firmware-linux-free - Binary firmware for various drivers in the Linux kernel
 linux-base - Linux image base package
 linux-doc-2.6.32 - Linux kernel specific documentation for version 2.6.32
 linux-headers-2.6.32-5-486 - Header files for Linux 2.6.32-5-486
 linux-headers-2.6.32-5-4kc-malta - Header files for Linux 2.6.32-5-4kc-malta
 linux-headers-2.6.32-5-5kc-malta - Header files for Linux 2.6.32-5-5kc-malta
 linux-headers-2.6.32-5-686 - Header files for Linux 2.6.32-5-686
 linux-headers-2.6.32-5-686-bigmem - Header files for Linux 2.6.32-5-686-bigmem
 linux-headers-2.6.32-5-all - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-alpha - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-amd64 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-armel - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-hppa - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-i386 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-ia64 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-m68k - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-mips - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-mipsel - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-powerpc - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-s390 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-sh4 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-sparc - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-all-sparc64 - All header files for Linux 2.6.32 (meta-package)
 linux-headers-2.6.32-5-alpha-generic - Header files for Linux 2.6.32-5-alpha-generic
 linux-headers-2.6.32-5-alpha-legacy - Header files for Linux 2.6.32-5-alpha-legacy
 linux-headers-2.6.32-5-alpha-smp - Header files for Linux 2.6.32-5-alpha-smp
 linux-headers-2.6.32-5-amd64 - Header files for Linux 2.6.32-5-amd64
 linux-headers-2.6.32-5-amiga - Header files for Linux 2.6.32-5-amiga
 linux-headers-2.6.32-5-atari - Header files for Linux 2.6.32-5-atari
 linux-headers-2.6.32-5-bvme6000 - Header files for Linux 2.6.32-5-bvme6000
 linux-headers-2.6.32-5-common - Common header files for Linux 2.6.32-5
 linux-headers-2.6.32-5-common-openvz - Common header files for Linux 2.6.32-5-openvz
 linux-headers-2.6.32-5-common-vserver - Common header files for Linux 2.6.32-5-vserver
 linux-headers-2.6.32-5-common-xen - Common header files for Linux 2.6.32-5-xen
 linux-headers-2.6.32-5-iop32x - Header files for Linux 2.6.32-5-iop32x
 linux-headers-2.6.32-5-itanium - Header files for Linux 2.6.32-5-itanium
 linux-headers-2.6.32-5-ixp4xx - Header files for Linux 2.6.32-5-ixp4xx
 linux-headers-2.6.32-5-kirkwood - Header files for Linux 2.6.32-5-kirkwood
 linux-headers-2.6.32-5-mac - Header files for Linux 2.6.32-5-mac
 linux-headers-2.6.32-5-mckinley - Header files for Linux 2.6.32-5-mckinley
 linux-headers-2.6.32-5-mvme147 - Header files for Linux 2.6.32-5-mvme147
 linux-headers-2.6.32-5-mvme16x - Header files for Linux 2.6.32-5-mvme16x
 linux-headers-2.6.32-5-openvz-686 - Header files for Linux 2.6.32-5-openvz-686
 linux-headers-2.6.32-5-openvz-amd64 - Header files for Linux 2.6.32-5-openvz-amd64
 linux-headers-2.6.32-5-orion5x - Header files for Linux 2.6.32-5-orion5x
 linux-headers-2.6.32-5-parisc - Header files for Linux 2.6.32-5-parisc
 linux-headers-2.6.32-5-parisc-smp - Header files for Linux 2.6.32-5-parisc-smp
 linux-headers-2.6.32-5-parisc64 - Header files for Linux 2.6.32-5-parisc64
 linux-headers-2.6.32-5-parisc64-smp - Header files for Linux 2.6.32-5-parisc64-smp
 linux-headers-2.6.32-5-powerpc - Header files for Linux 2.6.32-5-powerpc
 linux-headers-2.6.32-5-powerpc-smp - Header files for Linux 2.6.32-5-powerpc-smp
 linux-headers-2.6.32-5-powerpc64 - Header files for Linux 2.6.32-5-powerpc64
 linux-headers-2.6.32-5-r4k-ip22 - Header files for Linux 2.6.32-5-r4k-ip22
 linux-headers-2.6.32-5-r5k-cobalt - Header files for Linux 2.6.32-5-r5k-cobalt
 linux-headers-2.6.32-5-r5k-ip32 - Header files for Linux 2.6.32-5-r5k-ip32
 linux-headers-2.6.32-5-s390x - Header files for Linux 2.6.32-5-s390x
 linux-headers-2.6.32-5-sb1-bcm91250a - Header files for Linux 2.6.32-5-sb1-bcm91250a
 linux-headers-2.6.32-5-sb1a-bcm91480b - Header files for Linux 2.6.32-5-sb1a-bcm91480b
 linux-headers-2.6.32-5-sh7751r - Header files for Linux 2.6.32-5-sh7751r
 linux-headers-2.6.32-5-sh7785lcr - Header files for Linux 2.6.32-5-sh7785lcr
 linux-headers-2.6.32-5-sparc64 - Header files for Linux 2.6.32-5-sparc64
 linux-headers-2.6.32-5-sparc64-smp - Header files for Linux 2.6.32-5-sparc64-smp
 linux-headers-2.6.32-5-versatile - Header files for Linux 2.6.32-5-versatile
 linux-headers-2.6.32-5-vserver-686 - Header files for Linux 2.6.32-5-vserver-686
 linux-headers-2.6.32-5-vserver-686-bigmem - Header files for Linux 2.6.32-5-vserver-686-bigmem
 linux-headers-2.6.32-5-vserver-amd64 - Header files for Linux 2.6.32-5-vserver-amd64
 linux-headers-2.6.32-5-vserver-itanium - Header files for Linux 2.6.32-5-vserver-itanium
 linux-headers-2.6.32-5-vserver-mckinley - Header files for Linux 2.6.32-5-vserver-mckinley
 linux-headers-2.6.32-5-vserver-powerpc - Header files for Linux 2.6.32-5-vserver-powerpc
 linux-headers-2.6.32-5-vserver-powerpc64 - Header files for Linux 2.6.32-5-vserver-powerpc64
 linux-headers-2.6.32-5-vserver-s390x - Header files for Linux 2.6.32-5-vserver-s390x
 linux-headers-2.6.32-5-vserver-sparc64 - Header files for Linux 2.6.32-5-vserver-sparc64
 linux-headers-2.6.32-5-xen-686 - Header files for Linux 2.6.32-5-xen-686
 linux-headers-2.6.32-5-xen-amd64 - Header files for Linux 2.6.32-5-xen-amd64
 linux-image-2.6.32-5-486 - Linux 2.6.32 for old PCs
 linux-image-2.6.32-5-4kc-malta - Linux 2.6.32 for MIPS Malta
 linux-image-2.6.32-5-5kc-malta - Linux 2.6.32 for MIPS Malta (64-bit)
 linux-image-2.6.32-5-686 - Linux 2.6.32 for modern PCs
 linux-image-2.6.32-5-686-bigmem - Linux 2.6.32 for PCs with 4GB+ RAM
 linux-image-2.6.32-5-686-bigmem-dbg - Debugging infos for Linux 2.6.32-5-686-bigmem
 linux-image-2.6.32-5-alpha-generic - Linux 2.6.32 for Alpha
 linux-image-2.6.32-5-alpha-legacy - Linux 2.6.32 for Alpha Legacy
 linux-image-2.6.32-5-alpha-smp - Linux 2.6.32 for Alpha SMP
 linux-image-2.6.32-5-amd64 - Linux 2.6.32 for 64-bit PCs
 linux-image-2.6.32-5-amd64-dbg - Debugging infos for Linux 2.6.32-5-amd64
 linux-image-2.6.32-5-amiga - Linux 2.6.32 for Amiga
 linux-image-2.6.32-5-atari - Linux 2.6.32 for Atari
 linux-image-2.6.32-5-bvme6000 - Linux 2.6.32 for BVM BVME4000 and BVME6000
 linux-image-2.6.32-5-iop32x - Linux 2.6.32 for IOP32x
 linux-image-2.6.32-5-itanium - Linux 2.6.32 for Itanium
 linux-image-2.6.32-5-ixp4xx - Linux 2.6.32 for IXP4xx
 linux-image-2.6.32-5-kirkwood - Linux 2.6.32 for Marvell Kirkwood
 linux-image-2.6.32-5-mac - Linux 2.6.32 for Macintosh
 linux-image-2.6.32-5-mckinley - Linux 2.6.32 for Itanium II
 linux-image-2.6.32-5-mvme147 - Linux 2.6.32 for Motorola MVME147
 linux-image-2.6.32-5-mvme16x - Linux 2.6.32 for Motorola MVME162/6/7, MVME172/7
 linux-image-2.6.32-5-openvz-686 - Linux 2.6.32 for modern PCs, OpenVZ support
 linux-image-2.6.32-5-openvz-686-dbg - Debugging infos for Linux 2.6.32-5-openvz-686
 linux-image-2.6.32-5-openvz-amd64 - Linux 2.6.32 for 64-bit PCs, OpenVZ support
 linux-image-2.6.32-5-openvz-amd64-dbg - Debugging infos for Linux 2.6.32-5-openvz-amd64
 linux-image-2.6.32-5-orion5x - Linux 2.6.32 for Marvell Orion
 linux-image-2.6.32-5-parisc - Linux 2.6.32 for 32-bit PA-RISC
 linux-image-2.6.32-5-parisc-smp - Linux 2.6.32 for multiprocessor 32-bit PA-RISC
 linux-image-2.6.32-5-parisc64 - Linux 2.6.32 for 64-bit PA-RISC
 linux-image-2.6.32-5-parisc64-smp - Linux 2.6.32 for multiprocessor 64-bit PA-RISC
 linux-image-2.6.32-5-powerpc - Linux 2.6.32 for uniprocessor 32-bit PowerPC
 linux-image-2.6.32-5-powerpc-smp - Linux 2.6.32 for multiprocessor 32-bit PowerPC
 linux-image-2.6.32-5-powerpc64 - Linux 2.6.32 for 64-bit PowerPC
 linux-image-2.6.32-5-r4k-ip22 - Linux 2.6.32 for SGI IP22
 linux-image-2.6.32-5-r5k-cobalt - Linux 2.6.32 for Cobalt
 linux-image-2.6.32-5-r5k-ip32 - Linux 2.6.32 for SGI IP32
 linux-image-2.6.32-5-s390x - Linux 2.6.32 for IBM zSeries
 linux-image-2.6.32-5-s390x-tape - Linux 2.6.32 for IBM zSeries, IPL from tape
 linux-image-2.6.32-5-sb1-bcm91250a - Linux 2.6.32 for BCM91250A
 linux-image-2.6.32-5-sb1a-bcm91480b - Linux 2.6.32 for BCM91480B
 linux-image-2.6.32-5-sh7751r - Linux 2.6.32 for sh7751r
 linux-image-2.6.32-5-sh7785lcr - Linux 2.6.32 for sh7785lcr
 linux-image-2.6.32-5-sparc64 - Linux 2.6.32 for uniprocessor 64-bit UltraSPARC
 linux-image-2.6.32-5-sparc64-smp - Linux 2.6.32 for multiprocessor 64-bit UltraSPARC
 linux-image-2.6.32-5-versatile - Linux 2.6.32 for Versatile
 linux-image-2.6.32-5-vserver-686 - Linux 2.6.32 for modern PCs, Linux-VServer support
 linux-image-2.6.32-5-vserver-686-bigmem - Linux 2.6.32 for PCs with 4GB+ RAM, Linux-VServer support
 linux-image-2.6.32-5-vserver-686-bigmem-dbg - Debugging infos for Linux 2.6.32-5-vserver-686-bigmem
 linux-image-2.6.32-5-vserver-amd64 - Linux 2.6.32 for 64-bit PCs, Linux-VServer support
 linux-image-2.6.32-5-vserver-amd64-dbg - Debugging infos for Linux 2.6.32-5-vserver-amd64
 linux-image-2.6.32-5-vserver-itanium - Linux 2.6.32 for Itanium, Linux-VServer support
 linux-image-2.6.32-5-vserver-mckinley - Linux 2.6.32 for Itanium II, Linux-VServer support
 linux-image-2.6.32-5-vserver-powerpc - Linux 2.6.32 for uniprocessor 32-bit PowerPC, Linux-VServer suppo
 linux-image-2.6.32-5-vserver-powerpc64 - Linux 2.6.32 for 64-bit PowerPC, Linux-VServer support
 linux-image-2.6.32-5-vserver-s390x - Linux 2.6.32 for IBM zSeries, Linux-VServer support
 linux-image-2.6.32-5-vserver-sparc64 - Linux 2.6.32 for uniprocessor 64-bit UltraSPARC, Linux-VServer su
 linux-image-2.6.32-5-xen-686 - Linux 2.6.32 for modern PCs, Xen dom0 support
 linux-image-2.6.32-5-xen-686-dbg - Debugging infos for Linux 2.6.32-5-xen-686
 linux-image-2.6.32-5-xen-amd64 - Linux 2.6.32 for 64-bit PCs, Xen dom0 support
 linux-image-2.6.32-5-xen-amd64-dbg - Debugging infos for Linux 2.6.32-5-xen-amd64
 linux-libc-dev - Linux support headers for userspace development
 linux-manual-2.6.32 - Linux kernel API manual pages for version 2.6.32
 linux-patch-debian-2.6.32 - Debian patches to version 2.6.32 of the Linux kernel
 linux-source-2.6.32 - Linux kernel source for version 2.6.32 with Debian patches
 linux-support-2.6.32-5 - Support files for Linux 2.6.32
 linux-tools-2.6.32 - Performance analysis tools for Linux 2.6.32
 xen-linux-system-2.6.32-5-xen-686 - Xen system with Linux 2.6.32 on modern PCs (meta-package)
 xen-linux-system-2.6.32-5-xen-amd64 - Xen system with Linux 2.6.32 on 64-bit PCs (meta-package)
Closes: 518182 588551 598518 599021 599089 599395 599457 599507 599768
Changes: 
 linux-2.6 (2.6.32-25) unstable; urgency=high
 .
   [ Ben Hutchings ]
   * mmc: build fix: mmc_pm_notify is only available with CONFIG_PM=y
   * Add stable 2.6.32.24 (trivial fix, already applied)
   * ipg: Remove device claimed by dl2k from pci id table (Closes: #599021)
   * linux-image: Include modules.order in image packages (Closes: #598518)
   * [x86] isdn/i4l: Reenable ISDN4Linux drivers, but mark them as staging
     (Closes: #588551)
     - hisax: Disable device aliases that conflict with mISDN
   * Update Danish debconf template translation (Joe Hansen) (Closes: #599457)
   * [x86] KVM: SVM: Fix wrong intercept masks on 32 bit (Closes: #599507)
   * e1000: fix Tx hangs by disabling 64-bit DMA (Closes: #518182)
   * rt2x00: Fix calculation of required TX headroom (Closes: #599395)
   * Add drm changes from 2.6.32.22+drm33.10:
     - i915: Don't touch PORT_HOTPLUG_EN in intel_dp_detect()
     - i915: Kill dangerous pending-flip debugging
     - radeon: release AGP bridge at suspend
     - radeon: initialize set_surface_reg for rs600 asic
   * [x86] toshiba_acpi: Add full hotkey support (Closes: #599768)
 .
   [ Stephen R. Marenka ]
   * m68k: fix missing io macros.
   * m68k: modular swim on mac.
   * m68k: never build staging drivers on m68k.
   * m68k: build in rtc class on atari.
 .
   [ Ian Campbell ]
   * xen: do not truncate machine address on gnttab_copy_grant_page hypercall
     (Closes: #599089)
 .
   [ dann frazier ]
   * drm/i915: Sanity check pread/pwrite (CVE-2010-2962)
   * drm/i915: Rephrase pwrite bounds checking to avoid any potential overflow
   * GFS2: Fix writing to non-page aligned gfs2_quota structures (CVE-2010-1436)
   * hvc_console: Fix race between hvc_close and hvc_remove (CVE-2010-2653)
   * net sched: fix some kernel memory leaks (CVE-2010-2942)
   * niu: Fix kernel buffer overflow for ETHTOOL_GRXCLSRLALL (CVE-2010-3084)
   * rose: Fix signedness issues wrt. digi count (CVE-2010-3310)
   * Fix pktcdvd ioctl dev_minor range check (CVE-2010-3437)
   * ALSA: prevent heap corruption in snd_ctl_new() (CVE-2010-3442)
   * net sched: fix kernel leak in act_police (CVE-2010-3477)
   * sctp: Fix out-of-bounds reading in sctp_asoc_get_hmac() (CVE-2010-3705)
Checksums-Sha1: 
 c1ad34fb456b4a216f0935ea5af7723c4ecbf07b 6329 linux-2.6_2.6.32-25.dsc
 6fada680e1969f55d90876168d6d3c33a4eb4db4 13265962 linux-2.6_2.6.32-25.diff.gz
 081c34be29247bcb2c30df68c1ea3278418056c8 6044936 linux-doc-2.6.32_2.6.32-25_all.deb
 7e2c63446652d327518bb5ec85d0070dac4647f7 2722130 linux-manual-2.6.32_2.6.32-25_all.deb
 95499c8890865275a86e7c8c2df3e7ca879893a8 6822232 linux-patch-debian-2.6.32_2.6.32-25_all.deb
 354a75476c427498c25e772a464ece588f89bec3 64802158 linux-source-2.6.32_2.6.32-25_all.deb
 6ec7c34f97259a136ba34c87d6b6ae0ff144605f 151624 linux-support-2.6.32-5_2.6.32-25_all.deb
 3c3200cedffa482c1bdf76e6cecb20973b3b08e5 139972 firmware-linux-free_2.6.32-25_all.deb
 74563d2393b7fab50d00b1cca372aef48a1d56e2 158580 linux-base_2.6.32-25_all.deb
 b44d0c0a3c619bb7379c411f85c348769a6085b7 27167756 linux-image-2.6.32-5-486_2.6.32-25_i386.deb
 b133484600467e9b7de9f416b98ca0c6581a9390 483898 linux-headers-2.6.32-5-486_2.6.32-25_i386.deb
 4cc9fda5d840840fcfd4537da9ef7af4b7223b65 27309450 linux-image-2.6.32-5-686_2.6.32-25_i386.deb
 ab2dd79b4bd5b6302ddc778495ef51a231ff244a 485068 linux-headers-2.6.32-5-686_2.6.32-25_i386.deb
 7a6994e0534f013f19950ac3cff310596846dcc6 27507046 linux-image-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 7c0169e6de8ce0ccabbf63280b37532e685054a2 414325950 linux-image-2.6.32-5-686-bigmem-dbg_2.6.32-25_i386.deb
 2c9dc8b4210e66b80c9a77bde828d736ed18c1ac 523684 linux-headers-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 dc16107b938930add545dabc0da1b4a481c0e59a 28389050 linux-image-2.6.32-5-amd64_2.6.32-25_i386.deb
 00ede8296e315eed33b0a3ce6896032628ffa814 479484 linux-headers-2.6.32-5-amd64_2.6.32-25_i386.deb
 5c17633e2891b5159da51dc4f991bc7c6f227121 3882982 linux-headers-2.6.32-5-common_2.6.32-25_i386.deb
 ac7b9944cfea5cbb02ea30c3c8d7295994a08574 27644080 linux-image-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 f6941af762f7f97864dfc8d456f073fac583f46d 489247594 linux-image-2.6.32-5-openvz-686-dbg_2.6.32-25_i386.deb
 9d9488b8a1fe4ce784425b582c64e1fd73c711d7 548354 linux-headers-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 fdcfbe015dd78a3dd985966b6fc3d5882f6e2239 3934452 linux-headers-2.6.32-5-common-openvz_2.6.32-25_i386.deb
 785f7e6fd8e5c3799630206fbd70523ee3d0ada5 135192 linux-headers-2.6.32-5-all_2.6.32-25_i386.deb
 79f7c6a87a8f50cffe7963e67347eb628c75b85e 135246 linux-headers-2.6.32-5-all-i386_2.6.32-25_i386.deb
 f19ca2b468a1791f95e6512ca0a9664066b3f92d 831990 linux-libc-dev_2.6.32-25_i386.deb
 f5edc05730ca16c46518e2453fbf2126252a17f7 284136 linux-tools-2.6.32_2.6.32-25_i386.deb
 4f82a89157b280924dc2ddfb9a900533bfafa285 27365308 linux-image-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 bb1e73ecb0ad90b4f32466e4571337e176edacbc 485624 linux-headers-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 ecfbda71ceaa92bab593aefee62b795522288aa4 27560112 linux-image-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 5f836ffb79e5ceb7c5f2313065acf3907a04b159 424555158 linux-image-2.6.32-5-vserver-686-bigmem-dbg_2.6.32-25_i386.deb
 4cbb108bd3a026364ec85765cf8ebc13d8588741 526370 linux-headers-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 db7008ada94d8979736dce9b3d2b361e13393642 3915800 linux-headers-2.6.32-5-common-vserver_2.6.32-25_i386.deb
 60b1bed2335137d526084dfd0a473ec408e3f4bc 27594270 linux-image-2.6.32-5-xen-686_2.6.32-25_i386.deb
 732ac8a9e5cb62a848bb965dc4c17e9ffefc32a3 417132102 linux-image-2.6.32-5-xen-686-dbg_2.6.32-25_i386.deb
 f0bffd073408224159892fa09c4ab71ad6459a8a 526444 linux-headers-2.6.32-5-xen-686_2.6.32-25_i386.deb
 f379e4cc9bdf2313b0644d69df6d30126930e506 135178 xen-linux-system-2.6.32-5-xen-686_2.6.32-25_i386.deb
 ae9fd3ab07e106c5b1cd7950c9100a0e8b897693 3900326 linux-headers-2.6.32-5-common-xen_2.6.32-25_i386.deb
Checksums-Sha256: 
 fefda6736f77858b0119903be3510a7835667c192964c72cd6eb6b84a839fdb1 6329 linux-2.6_2.6.32-25.dsc
 9059ff37bfe26a2fa2bdc6853dd520ec9ce08d7f46708bc1615923dac963d870 13265962 linux-2.6_2.6.32-25.diff.gz
 d41752191e826e14785f4103249861172941b493b9a59f4b679b7bf76d6db57f 6044936 linux-doc-2.6.32_2.6.32-25_all.deb
 fb783d3b1867812ef6eee29cf8865d278044a6bd83b7e3bf2d80684510ac2636 2722130 linux-manual-2.6.32_2.6.32-25_all.deb
 c4888f512cbb5d6c35152890da77630f0d3331dd0a6e872d52a1d93f9d8d6809 6822232 linux-patch-debian-2.6.32_2.6.32-25_all.deb
 6f5afbaf35ab10705925e9a78c53957f58b76d0fd837c8e3714ade00aa273634 64802158 linux-source-2.6.32_2.6.32-25_all.deb
 2814a2f965c5b8bd8e756d60eb010b6ea966d6979dd52ac87ec680eee6c11abd 151624 linux-support-2.6.32-5_2.6.32-25_all.deb
 08bd047df25ae05d9b4e6ffc00195b4251d115fdd3804255f22f5e1e1984d251 139972 firmware-linux-free_2.6.32-25_all.deb
 90ea33b94b645e7dc904210b3857876b7075ab51f56f6544e2bb801add5856a8 158580 linux-base_2.6.32-25_all.deb
 03a8928ab84e1beeedac41e4bbcd7c172ede03ea99a8da5908d5b8007e1de1e9 27167756 linux-image-2.6.32-5-486_2.6.32-25_i386.deb
 3eb6286413cf161bdfbf735c421e148b555c2174d66e0a42c878728ca4fc9ff1 483898 linux-headers-2.6.32-5-486_2.6.32-25_i386.deb
 7073c64d516dbd84e45a4d5fbe7ebeeae2be98ad8ca44c9776f420864efbd485 27309450 linux-image-2.6.32-5-686_2.6.32-25_i386.deb
 7899ff7dbf52e50179894f8d9d99e5ac7b7d0a8f773bbe6632bc7723087dda35 485068 linux-headers-2.6.32-5-686_2.6.32-25_i386.deb
 cf7b174aaca90e78d94e18b93eb113e72396cf2da4e5be819d4ddf50f7bd71d6 27507046 linux-image-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 d1883f47d48587d8be209fbfec82794169f2bdf42e44396b8b32cb011d6c69f5 414325950 linux-image-2.6.32-5-686-bigmem-dbg_2.6.32-25_i386.deb
 7b58a5cec53f5a932d3523c3204bad7ee6f4efe2172611195c3194fcbc1196ff 523684 linux-headers-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 7453f159b33dd44baa502d34921d414dc3e03bb42fdb591f7b2e8ba44e644d77 28389050 linux-image-2.6.32-5-amd64_2.6.32-25_i386.deb
 3b9b90fc1eb0ca221c10a2cc59d3e9fbf1f55be0e8c391a493c9b974fd1f8145 479484 linux-headers-2.6.32-5-amd64_2.6.32-25_i386.deb
 5a49722ee95fe75efede6ec8af57b4515ae9cd911dfea2d8ea591bbdb726bb9f 3882982 linux-headers-2.6.32-5-common_2.6.32-25_i386.deb
 e6c13a1e9c4f86b23645a0dd86e15940628b8429c7f7cda0fcb20b4250a1aaa6 27644080 linux-image-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 f88725dff30a784485b160c625f7e6bcc8084d799b31b2d5c5d66ac1cc18cae1 489247594 linux-image-2.6.32-5-openvz-686-dbg_2.6.32-25_i386.deb
 6de8eea476945481ec6b2e23f473d1729ba8ad94a3fa98378518917690a2ce0d 548354 linux-headers-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 1f384d877a4cb8296934f9789c91dc8d6609052c969c398539e5e33db41c9da3 3934452 linux-headers-2.6.32-5-common-openvz_2.6.32-25_i386.deb
 c9face8621507cab3fc4314ac0a464adfe06e97c366541accfa262c550df2658 135192 linux-headers-2.6.32-5-all_2.6.32-25_i386.deb
 665d4025ae71cc735c289b77251f73b5a98b7153aed6c0a563ff540b7bc92eeb 135246 linux-headers-2.6.32-5-all-i386_2.6.32-25_i386.deb
 cb61c43191f1f4a86d2f124266c31aec14d33636ea74e8e45432e5f8016eac29 831990 linux-libc-dev_2.6.32-25_i386.deb
 1c0e009a45c7c3859ae20b653ea4383f87e53639d7a419f9015cd7b3b8757312 284136 linux-tools-2.6.32_2.6.32-25_i386.deb
 2faa1003c0435489a3bd3120c975b5ed36d9417769c16d82a9c468c234380686 27365308 linux-image-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 07abe5140d110e1db0e60214d64762b77b1a6690266eba55c37848c8a6c08754 485624 linux-headers-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 f328dfac634cb01d9b795dafb74ed2ed1308f2f81011dd46fcda6bcd935999ad 27560112 linux-image-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 8b9c004da85348ea78502ecc3f55d43e31ec9a8c142e48cad4e5b250ed2b0557 424555158 linux-image-2.6.32-5-vserver-686-bigmem-dbg_2.6.32-25_i386.deb
 90b016d1f55ec15527807fae14a688eb20f00d5e458d4fc21d2ca3f92d7d3483 526370 linux-headers-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 a320c3ec6519a86399f51ebed816192fe8b8e44689e40b4c49b7a1be55946d65 3915800 linux-headers-2.6.32-5-common-vserver_2.6.32-25_i386.deb
 9a24a1e43df303a1acee89b00677616aca6b05c13a1f2f380850209d58d0bfdc 27594270 linux-image-2.6.32-5-xen-686_2.6.32-25_i386.deb
 aa821a037f37755f33c89bb895d560c4e357b43e179c39d9430bb26c44fe692f 417132102 linux-image-2.6.32-5-xen-686-dbg_2.6.32-25_i386.deb
 c833a32e0c448e30019efa0911e9d8a345646ee7accf464f8ac3b7620b005aec 526444 linux-headers-2.6.32-5-xen-686_2.6.32-25_i386.deb
 b5d4b7c555eeb3889f5b92b7cc5ba4cc3900bc158ccb65e7c9c48cc35024b23a 135178 xen-linux-system-2.6.32-5-xen-686_2.6.32-25_i386.deb
 734ec7bfd3f11ebb10d13528feb9e07805b6262b370782d3c5533d115c862c95 3900326 linux-headers-2.6.32-5-common-xen_2.6.32-25_i386.deb
Files: 
 0562009655dac8f85a6765fa4fb3e365 6329 kernel optional linux-2.6_2.6.32-25.dsc
 a2d3de301fbf9a71351bc30ec5322cad 13265962 kernel optional linux-2.6_2.6.32-25.diff.gz
 795ed01ea800ee09b2981e8415ddd72a 6044936 doc optional linux-doc-2.6.32_2.6.32-25_all.deb
 f73c637355f6e7893d93f4a6deab4e77 2722130 doc optional linux-manual-2.6.32_2.6.32-25_all.deb
 b451b9bc0dbdce3798a3dc1123bc4893 6822232 kernel optional linux-patch-debian-2.6.32_2.6.32-25_all.deb
 e2b2ca50a41633c3fa9a84d3b7a1ba8f 64802158 kernel optional linux-source-2.6.32_2.6.32-25_all.deb
 96cdb41c57c4f1655cd9df8cb9eaea29 151624 devel optional linux-support-2.6.32-5_2.6.32-25_all.deb
 0482f9fca28f89aaa6f18d0839f22500 139972 kernel optional firmware-linux-free_2.6.32-25_all.deb
 8634ebd77694572dd9b33af1e8716a58 158580 kernel optional linux-base_2.6.32-25_all.deb
 f29bd284665aad5f82cd2380c4378783 27167756 kernel optional linux-image-2.6.32-5-486_2.6.32-25_i386.deb
 ef0e901ec481cb66881d6e36c6cdf0c6 483898 kernel optional linux-headers-2.6.32-5-486_2.6.32-25_i386.deb
 9d77b10b1ce660a0e039790853539fda 27309450 kernel optional linux-image-2.6.32-5-686_2.6.32-25_i386.deb
 45b5460d56aa8b55990da8ca8d4ac577 485068 kernel optional linux-headers-2.6.32-5-686_2.6.32-25_i386.deb
 28d60b3be3e0a819f4f5dfb2c41ebcac 27507046 kernel optional linux-image-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 6347c4264634e0ad2a4f6bcd6d949580 414325950 debug extra linux-image-2.6.32-5-686-bigmem-dbg_2.6.32-25_i386.deb
 951f416ea685dd477347bbfc285e3d0e 523684 kernel optional linux-headers-2.6.32-5-686-bigmem_2.6.32-25_i386.deb
 011f33982730c79e7dc5e7d342d349d5 28389050 kernel optional linux-image-2.6.32-5-amd64_2.6.32-25_i386.deb
 2fc9350f153bfb1caab4b53a8b25ae7e 479484 kernel optional linux-headers-2.6.32-5-amd64_2.6.32-25_i386.deb
 992bd6281ab22634d6a7580a516c4f6d 3882982 kernel optional linux-headers-2.6.32-5-common_2.6.32-25_i386.deb
 e7a5a66d5f79d9d423d861234aea8df7 27644080 kernel optional linux-image-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 3f409ad4108c67e096cf47f9f0d5981c 489247594 debug extra linux-image-2.6.32-5-openvz-686-dbg_2.6.32-25_i386.deb
 e7ba275a4c18e97daa96f1a7b4876e59 548354 kernel optional linux-headers-2.6.32-5-openvz-686_2.6.32-25_i386.deb
 c749744a693518d0dc85485cb3429521 3934452 kernel optional linux-headers-2.6.32-5-common-openvz_2.6.32-25_i386.deb
 b1e2bd0e15805b055d50e8f351ce893f 135192 kernel optional linux-headers-2.6.32-5-all_2.6.32-25_i386.deb
 35851bb4e0ccdbcaa76a4f9a952ade05 135246 kernel optional linux-headers-2.6.32-5-all-i386_2.6.32-25_i386.deb
 b312ad6b6d30790ac7db4ed2e18e5c0e 831990 devel optional linux-libc-dev_2.6.32-25_i386.deb
 51c9f7695d19ecf2ca2f727c26276d7d 284136 kernel optional linux-tools-2.6.32_2.6.32-25_i386.deb
 b88a7276f18ca51092598a8c52e429ef 27365308 kernel optional linux-image-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 c72f4bd8d170fe315a82d323d4711b12 485624 kernel optional linux-headers-2.6.32-5-vserver-686_2.6.32-25_i386.deb
 aee94a68a93ea1c570e66a697bf4422d 27560112 kernel optional linux-image-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 fcd341a051d254912b62bba30ba63069 424555158 debug extra linux-image-2.6.32-5-vserver-686-bigmem-dbg_2.6.32-25_i386.deb
 63de068cfaf9ea7d432abe6f8f6c470d 526370 kernel optional linux-headers-2.6.32-5-vserver-686-bigmem_2.6.32-25_i386.deb
 908dede1ccb619107a113ff2fcc2ae8b 3915800 kernel optional linux-headers-2.6.32-5-common-vserver_2.6.32-25_i386.deb
 200e16251e01044a2804ef69ecc07237 27594270 kernel optional linux-image-2.6.32-5-xen-686_2.6.32-25_i386.deb
 307101bd453c4117b28b2b601eecde6d 417132102 debug extra linux-image-2.6.32-5-xen-686-dbg_2.6.32-25_i386.deb
 ec3c499b8c55c55fd9a9e42295ce1a41 526444 kernel optional linux-headers-2.6.32-5-xen-686_2.6.32-25_i386.deb
 b07a3a436c8ff2d23dddbac49f7cb1d0 135178 kernel optional xen-linux-system-2.6.32-5-xen-686_2.6.32-25_i386.deb
 9df335d47c580f9257a55351250b02c1 3900326 kernel optional linux-headers-2.6.32-5-common-xen_2.6.32-25_i386.deb

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iD4DBQFMt3KUhuANDBmkLRkRAh+ZAJig5TmqZzJJsNqGT0nICH50PNHaAJ47ky1t
UDPl9Dl8l01dkeJ2oyIBFw==
=yIam
-----END PGP SIGNATURE-----





Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Mon, 10 Jan 2011 07:46:39 GMT) Full text and rfc822 format available.

Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Sat Apr 19 06:32:13 2014; Machine Name: beach.debian.org

Debian Bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.