Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I have a virtual environment running vSphere 5.1. I have two ESXis with a vDS between them. There is, for the purposes of the discussion, just one portgroup on that vDS configured to use a VLAN. The uplink of each host is made of two teamed NICs, which are both connected to the same physical switch. On another port of the physical switch there is a firewall with one leg in the same VLAN as the portgroup.

I have observed that occasionally, when creating and starting a new VM on host1, the switch will not learn this VM's MAC address (even if I force a gratuitous ARP using arping). When this happens, the VM will not be able to communicate with the firewall, or even with other VMs (that use the same portgroup) on host2. However, it can still communicate with other VMs on host1 that are connected to the same portgroup.

Furthermore, if there is a VM on host1 that is working fine and can communicate externally, and I vMotion it to host2, then the switch will not learn that the MAC address has moved to a different port (again, even after I issue arping from the VM), and as a result this VM will lose connectivity to the firewall.

To add to the confusion, and this is just driving me crazy, if I run a "ping -t " from the firewall, while a VM is starting up, then the switch will learn the VM's MAC address and the VM will be able to communicate.

The "notify switches" option is turned on both at the portgroup and the uplink.

What could I be missing here? I am willing to consider crazy ideas. Tomorrow I will try rebooting the hosts just in case the vDS configuration is out of sync...

share|improve this question
    
Please provide details about the hosts, ESXi patch level and switching equipment involved... –  ewwhite Jan 15 at 21:28
    
@ewwhite Hosts are running ESXi 5.1 build 838463. I'll have to get back to you about the switching equipment. Are you implying this could be a hardware issue in the switch? –  telewin Jan 15 at 21:33
    
No, just need to know the switch make/model to help troubleshoot. Cisco != HP Procuve != Linksys. –  ewwhite Jan 15 at 21:46
1  
I'm inclined to think this is some kind of problem with the switch, actually... sounds like packets are going though the port without the MAC being learned, which would definitely be a problem with the switch. Can you check whether that's happening? –  Shane Madden Jan 16 at 0:57
1  
@ShaneMadden Physical switch it was! –  telewin Mar 18 at 22:13

2 Answers 2

My advice to you is to upgrade your ESXi installations. Things like this sometimes fall into the bug category, and according to VMware, your build number (838463) is from October 2012. The current release is build 1312873.

It makes sense to patch if you can, since you're working with a very old build.

Also see: Are VMware ESXi 5 patches cumulative?

share|improve this answer
up vote 1 down vote accepted

For what it's worth, this turned out to be a physical switch issue. There's a very long thread at https://communities.vmware.com/thread/421560 that proved immensely helpful (if only by showing us that we were not alone in this...).

Thank you all for the help!

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.