A few days ago the internal interface on one of my backup servers went down, and I've not been able to get it to work correctly since. In dmesg, I'm seeing:
ADDRCONF(NETDEV_UP): eth0: link is not ready
bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
bnx2: eth1: using MSI
ADDRCONF(NETDEV_UP): eth1: link is not ready
bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex
ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
eth0: no IPv6 routers present
bnx2: eth1 NIC Copper Link is Down
eth1: no IPv6 routers present
eth0 is working correctly as before, but eth1 appears to connect, come up and then drop pretty much straight afterwards. On the first visit out to the data centre plugging in a new ethernet cable appeared to temporarily correct the problem, but since then it's occurred again and now happens consistently.
I've tried:
- Swapping switch ports (thinking it may have been a dead/dieing port on this Cisco 2960)
- Swapping in a new cable, but still doesn't work, and both cables work correctly in my test laptop.
Could this be a software issue?? Any other ideas?
Edit: Further information
My /etc/sysconfig/network-scripts/ifcfg-eth1 looks like:
# Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet
DEVICE=eth1
HWADDR=00:22:19:**:**:**
DHCP_HOSTNAME=******.*******.COM
ONBOOT=yes
BOOTPROTO=static
IPADDR=192.168.0.117
NETMASK=255.255.255.0
#ETHTOOL_OPTS="autoneg on"
(I've since commented out the ETHTOOL_OPTS="autoneg on" for testing)
Update: I had a test switch in the rack (consumer gigabit Netgear) which we use for the internal DRAC network management network. Plugging this into the local switch and then into the server yields:
eth1: no IPv6 routers present
bnx2: eth1 NIC Copper Link is Up, 100 Mbps full duplex, receive & transmit flow control ON
It's not gigabit, but appears to be working perfectly. (not concerned with the network speed at this time). However how would I go about debugging an issue like this, the server is no different than the 20 other Poweredge 2950's we've got in there, all with the same configuration and still working correctly. The only time I'd seen an issue like thsi is connecting the DRAC cards to the Cisco 2950's (they refused to auto negotiate too).
Could this be a failing NIC, that's now not auto negotiating properly or is there something I should be checking on the system itself which may be messing it up?