Firstly, although knowing about AWS for a long time, this is the first time i've ever used it.
I gather that EBS volumes are for persistent data storage and instance store volumes are for one time use. I'm using the instances for data mining so they are launched on spot instances and use a lot of I/O while for filling requests for the master.
I cant use EBS because the I/O costs a fortune and i dont need the instance to survive, it gets a job from the master server, processes the job and returns it, no data needs to be saved on the instance. I feel that i need to use Instance Store but there doesn't seem to be a way to save an AMI and load it as an instance store. How am i meant to set this up ? I cant log into the instances every time to set them up, plus it takes 10 minutes to install required dependency. I assumed i'd be able setup the instance store instance, then save, and just load copys of that. Can anyone tell me where I'm going wrong or what i should do in this situation.