Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I currently have a Linux server running with around 10,000 users daily on it. The hosting provider offers a backup which I'm also using. Although I trust my hoster, I would like to have an offsite backup, just in case the host goes down for a longer time or goes bankrupt (you never know). My idea was to tar and split the data and copy the archive to my Amazon S3 account, but I'm wondering if that's the best idea.

share|improve this question
    
After some testing with tarsnap and jungledisk, I settled for another cheap server in another datacenter. As a backup tool, I'm using rsnapshot since the backup speed (after the initial upload) is very fast and so is the recovery. tarsnap was too slow for recovery and the jungledisk client was too flaky. –  andypa Aug 7 '12 at 21:25
add comment

4 Answers

up vote 1 down vote accepted

Best was to offsite-backup 30GB of data?

I'd probably say rsync with your Amazon S3, but keep in mind that its 30gb, so bandwidth costs will be high (if you pay 95%) and it'll take a long time to get your initial push up there. Once your data is up there just keep the files rsynced nightly / weekly / whatever your preference is.

however, Thats ONLY the backup side, dont forget about recovery. I'd purchase a second server in a second datacenter, have similar builds, and rsync the changes nightly.

share|improve this answer
    
My final solution: github.com/pcorliss/s3cmd-modification <-- the --parallel modification, which enables multiple uploads plus S3 versioning is the best solution so far for me. –  andypa Oct 7 '12 at 8:52
add comment

An S3 account isn't impractical for that size of data set -- at 10Mbps, it'll take about 9 hours to transfer all that data. Whatever you do, though, think about recovery -- are you OK with being down for the 9 hours (on top of whatever provisioning time you need for your new machine) it takes to download your 30GB of data back onto your server? Keep an eye on your data set growth, too, and keep re-evaluating that choice. At some point, it may make sense to find someone who's willing to ship you physical media (a bunch of DVDs or a USB hard drive), but for now a purely network-accessable system should suit you fine.

share|improve this answer
    
The server has a 100Mbps connection and during the night, the network connection isn't heavily used. If I'm not ok with a downtime, the only other thing would be to have a parallel server running at a different hoster, correct? –  andypa Jan 20 '10 at 6:09
2  
Downtime avoidance, in general, is a large and complicated issue, not something to be covered in a comment on an unrelated answer. –  womble Jan 20 '10 at 6:28
1  
+1 for thinking about recovery. –  GruffTech Jan 27 '10 at 22:33
add comment

Sounds like tarsnap might be just what you need. Cheap too.

share|improve this answer
    
I tried tarsnap but the recovery was way too slow. I rented a 2nd server with some harddisks and I'm using rsnapshot. –  andypa Aug 7 '12 at 21:22
add comment

You may also want to look into JungleDisk as well. There service basically adds decent encryption and interface/app to S3 allowing for realtime data backup.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.