Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

According to the Amazon EC2 FAQ, when an instance is terminated the data is gone. What steps can I take to preserve data in the event my instance is rebooted? I've been looking into EBS and S3 - would either of these be useful to store an active database? How often are instances rebooted anyways?

share|improve this question

migrated from stackoverflow.com Jul 27 '09 at 1:24

This question came from our site for professional and enthusiast programmers.

2  
A sidenote about terminology: note that terminating an instance is different from merely rebooting it. Terminating wipes the instance storage while rebooting doesn't (see e.g. stackoverflow.com/questions/637790/…). So you don't actually mean rebooting :) –  Jonik Apr 24 '10 at 8:18
add comment

5 Answers

up vote 23 down vote accepted

Like others have said, EBS--Elastic Block Storage. I am using it myself now that it is released to the general public. It is better than S3 on multiple points:

  • EBS are fast. Faster than even the local mounts, according to Amazon.
  • EBS mounts as proper devices. Unlike S3, which you'll need custom S3 oject access logic in your code, or middleware (JungleDisk, ElasticDisk, et al) which present their own problems and costs
  • EBS are easy to back up. Amazon give one the ability to take snap shots, which are saved on S3
  • EBS are portable between instances--volumes can be unmounted from one instance, and attached to another instance
  • EBS devices can even be RAID'ed together for improved reliability

My experience with EBS so far has been the most positive thing about AWS I've dealt with to date.


Update: While my experience with EBS has been positive, others have had issues. Very specifically EBS do not implement fsync() correctly. Ted Dziuba has some interesting words about this in his blog post Amazon — The Purpose of Pain: Myth 2: Architecture Will Save You from Cloud Failures

This gets even more entertaining with Amazon Elastic Block Store, which, as the Reddit administrators have found, will happily accept calls to fsync(), and lie to your face, saying that the data has been written to disk, when it may not have been.

share|improve this answer
    
EBS are sometimes fast, sometimes slow. RAIDing multiple volumes together helps a lot. –  ceejayoz Oct 26 '11 at 12:58
add comment

EBS would certainly work for a database, and is one of the examples in Amazon's EBS Description. "Amazon EBS is particularly suited for applications that require a database..."

EBS will work just like a block device (think hard disk), giving you broad freedom and comfortability using it. S3 is conceptually more like really fast FTP, with a special API. You could conceivably use it as part of a database, but standard databases don't run on it (yet?).

You will want to review Amazon's descriptions of performance (EBS > S3), durability (S3 > EBS) and price (depends).

share|improve this answer
add comment

As mentioned in other answers, EBS is the standard solution for persistent and convenient disk storage. It should be your default option. Indeed, the newer EC2 instance types use it by default, over the original, non-persisted instance storage.

However, when considering persistence, you'll also want to carefully consider availability (avoiding times when the data is not available) and durability (avoiding loss of data) for your data.

EBS covers the basic use cases, but keep in mind:

  • S3 is designed for higher durability than EBS. Simply put, they keep more copies of your data, and claim extremely high 99.999999999% durability for S3 (see the S3 FAQ). The actual numeric probability here (which is so high it makes martian invasions look more probable) is not as important as the fact that AWS has staked their reputation on S3 durability and has a very good record here. The same is not true for EBS.
  • While Amazon will not give statistics on this directly, many people believe instance storage has historically offered higher availability than EBS.

Recent AWS outages, such a severe multi-day failure in 2011 and another in 2012, give some illustrations of the complexities of EBS and the small but non-negligible risks of outages and data loss.

Bottom line: To be sure you won't lose your data, keep data backups in S3. EBS snapshots are an easy way to do this for EBS. If high availability is critical, consider also using instance storage in multiple availability zones (in addition to, or instead of, EBS).

share|improve this answer
add comment

this site - http://www.sunsetlakesoftware.com/2008/09/13/running-drupal-website-amazon-ec2 -- shows how to make an ebs mount as a persistent drive and automatically take snapshots

share|improve this answer
add comment

Sounds like if you're worried about losing data then you need the above mentioned EBS. There's a bit of an intro here.

I haven't personally looked into it much more than this thus far, I'm just using S3 for backups currently.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.