1

I have a virtual environment running vSphere 5.1. I have two ESXis with a vDS between them. There is, for the purposes of the discussion, just one portgroup on that vDS configured to use a VLAN. The uplink of each host is made of two teamed NICs, which are both connected to the same physical switch. On another port of the physical switch there is a firewall with one leg in the same VLAN as the portgroup.

I have observed that occasionally, when creating and starting a new VM on host1, the switch will not learn this VM's MAC address (even if I force a gratuitous ARP using arping). When this happens, the VM will not be able to communicate with the firewall, or even with other VMs (that use the same portgroup) on host2. However, it can still communicate with other VMs on host1 that are connected to the same portgroup.

Furthermore, if there is a VM on host1 that is working fine and can communicate externally, and I vMotion it to host2, then the switch will not learn that the MAC address has moved to a different port (again, even after I issue arping from the VM), and as a result this VM will lose connectivity to the firewall.

To add to the confusion, and this is just driving me crazy, if I run a "ping -t " from the firewall, while a VM is starting up, then the switch will learn the VM's MAC address and the VM will be able to communicate.

The "notify switches" option is turned on both at the portgroup and the uplink.

What could I be missing here? I am willing to consider crazy ideas. Tomorrow I will try rebooting the hosts just in case the vDS configuration is out of sync...

  • Please provide details about the hosts, ESXi patch level and switching equipment involved... – ewwhite Jan 15 '14 at 21:28
  • @ewwhite Hosts are running ESXi 5.1 build 838463. I'll have to get back to you about the switching equipment. Are you implying this could be a hardware issue in the switch? – telewin Jan 15 '14 at 21:33
  • No, just need to know the switch make/model to help troubleshoot. Cisco != HP Procuve != Linksys. – ewwhite Jan 15 '14 at 21:46
  • 1
    I'm inclined to think this is some kind of problem with the switch, actually... sounds like packets are going though the port without the MAC being learned, which would definitely be a problem with the switch. Can you check whether that's happening? – Shane Madden Jan 16 '14 at 0:57
  • 1
    @ShaneMadden Physical switch it was! – telewin Mar 18 '14 at 22:13
1

My advice to you is to upgrade your ESXi installations. Things like this sometimes fall into the bug category, and according to VMware, your build number (838463) is from October 2012. The current release is build 1312873.

It makes sense to patch if you can, since you're working with a very old build.

Also see: Are VMware ESXi 5 patches cumulative?

1

For what it's worth, this turned out to be a physical switch issue. There's a very long thread at https://communities.vmware.com/thread/421560 that proved immensely helpful (if only by showing us that we were not alone in this...).

Thank you all for the help!

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.