We have serious stability issues with mysqld running on Linux hosts in EC2, with all of its data and log files stored on an EBS volume. We keep a slave purely for hot backup and failover, and when the master goes down, we can usually bring up the slave as a master without any issues, and then create a new slave.
But it's very problematic that our master will just go down. The master host keeps running fine, but mysqld won't respond to anything, and can't even be killed with kill -9.
This happens in both our production and staging environments, which are similar, but production runs on large instances (with Centos 5.2 x86_64) and staging on medium instances (with Centos 5.2 i686).
Has anybody experienced similar mysqld stability problems in EC2, and if so, how did they deal with them?
Thanks in advance.