I have been reading about the ephemeral storage with amazon ec2 and am trying to figure out what is the best way to use the 100s of GBs they supply you. If it isn't persistent, what can it be good for?
As Flashman pointed out the ephemeral storage is "persistent" for the life of the instance -- It's great for stuff like
If you routinely need to process huge data files to distill them down into more usable information this is a great option -- you can keep hundreds of gigs of original data on the ephemeral storage & put the distilled data someplace more permanent.
Temporary files and/or as a swap partition.
Here are some instructions for automatically creating a swap drive on boot. To quote the article...
Create a service named ‘swapon’.
And add the following content:
This service will generate a swap file of 8GB (hence the 8M * 1024byte). If you need less or more, change the ‘count’ parameter.
Now last step: let’s assign execute rights and enable this script/service at boot time.
Now your swap will be created every time you boot (or reboot) your EC2 instance.
.. /end quote.
You might be able to do something similar with the Windows page file but I haven't seen any instructions for it. I don't think you can just format the drive and move the pagefile across because the next time the instance starts the disk(s) will be initialized again (and moving the page file requires a restart.. ).
Also, keep in mind that most instance types come with multiple ephemeral disks (presumably) representing separate physical drives so striping across these devices (ie. RAID 0, for no redundancy or RAID 10 for redundancy) should improve swap performance further.