I have been using AWS spot instances with persistance storage; something along these lines. I have been this successfuly for months with different instance types, and extended my volume several times as i got more data (128gb > 256gb > 512gb).
In my last experiment, I extended my ebs volume to 1TB, ran some batch process on a m4.16xlarge machine, and after one day, the second status check failed (instance reachability check); unfortunetly i don't have the system log for that moment now.
I thought it's a generic failure, and launched a new c4.8xlarge spot instance with the same ebs volume; no errors, ssh successful, data there.
Now i'm trying to create a new m4.16xlarge with the same ebs, but it fails; full server log here. I'm not able to mount the volume with this or any other instance type now.
Do you have ideas what might have wrong and how i can remedy this?