I'm testing the RedHat Cluster Administration tool documented here: https://access.redhat.com/site/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Cluster_Administration/index.html
I have two virtual machines running CentOS 6.4. I've been testing failover scenarios; restarting the primary machine, and gracefully shutting down the primary machine both successfully migrate the resources to the secondary machine (things like DRBD, Tomcat, MySQL, Apache).
However, I wanted to simulate a complete power failure, or a forced shutdown. In the XenCenter client, I forcefully shutdown the primary machine, and watch the logs on the secondary. In short, the resources seem to NEVER migrate over to the secondary, and the cluster management interface seems to think that the services are still running on the primary.
Here's the output from the secondary machine logs: http://pastebin.com/gsi6uBct
It's complaining mostly about fencing. But I don't understand: if the primary node completely dies on its own, there's nothing to fence.