2
votes
2answers
407 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
3
votes
3answers
852 views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
0
votes
2answers
60 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
1
vote
0answers
78 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
0answers
27 views

EBS Snapshot backs up Instance - Is S3 also needed?

I have spent lots of hours reading about EBS & S3 backups. I believe this is the proper approach for our needs but I am not a SysAdmin. Setup: 1 EC2 Server w/ apache & database Over 250000 ...
2
votes
1answer
517 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
0answers
87 views

How continue sync with S3CMD after broken connection?

I'm using s3cmd to backup some logs into Amazon S3 buckets. Which is a great tool. But I notice that, very often, my sync's are broken, they just cancel and try to upload again, until they can upload ...
0
votes
1answer
191 views

Upload database backup from mysql to Amazon S3 or Glacier without creating local file

Is there a tool that makes possible to backup a Mysql database to Amazon S3 or Amazon Glacier without having o create a local file with the database contents? Something like that: mysqldump -u ...
6
votes
6answers
931 views

Does a CDN still work even when my server is down?

I am a website owner planning to use Amazon's cloudfront S3. I have been reading all the stuffs about what a CDN can do but i still have an unanswered question. Does a CDN still work even when my ...
0
votes
0answers
124 views

Backing up files from my EC2 instance to S3

Hi I have a set of neat scripts that backup my dbs into db.sql.gz files under a folder on on ec2 host. My files are of the form (as you can see they are weekly rolling backups) ...
1
vote
1answer
433 views

Best failover strategy for e-mail servers on AWS to ensure high availability

We have our e-mail server hosted on AWS. Last week Amazon had a failure in their East Coast region which brought down our server along with many others. We now want to implement a failover strategy ...
3
votes
3answers
2k views

What's the best way to backup cPanel WHM server to Amazon S3? [closed]

I would like to archive cPanel backups to Amazon S3 instead of FTP. I've done some googling, but I'm not finding anything authoritative. I found the following options: whms3backup.com - $250 for ...
1
vote
3answers
301 views

Backing up data (including mysqldumps) to S3

We have a web app on a number of servers and we want to add an additional layer of redundancy by backing up the key data to S3. The key data is the MySQL database and a folder containing dynamically ...
0
votes
4answers
951 views

Easiest to use backup software for live linux server [closed]

I need a backup software that is capable of: doing a full HDD image (from live server, if that's possible at all?)or just copy everything except /dev, /tmp, etc updates the backup incremental just ...
4
votes
2answers
1k views

Duplicity not writing to a pre-existing S3 bucket

I'm trying to backup a directory to a pre-existing Amazon S3 bucket using the following command: duplicity --no-encryption system/ s3+http://MY_BUCKET_NAME/backup However, I'm getting the following ...
2
votes
1answer
403 views

Amazon S3 Website & MySQL Backup

I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb. ...
10
votes
3answers
3k views

Any need to make backup of data on Amazon S3?

I'm hosting 200 GB of product images at S3 (this is my primary file host). Do I need to back that data up somewhere else, or is S3 safe as it is? I have been experimenting with mounting the S3 ...
6
votes
4answers
5k views

s3cmd fails too many times

It used to be my favorite backup transport agent but now I frequently get this result from s3cmd on the very same Ubuntu server/network: root@server:/home/backups# s3cmd put bkup.tgz s3://mybucket/ ...
0
votes
1answer
153 views

Alternative storage for SVN backup with rsync

I've been backing up my SVN repo and trac environment using a weekly cron job and 2 custom scripts. This has been going to Joyent Strongspace; but since they have discontinued the service, I need an ...
2
votes
3answers
232 views

Bandwidth-friendly backup strategy using tar?

We've used tar to backup and compress (gzip) selected directories on our file server with very good results until recently. Each and every one of our backups are stored on mirrored (RAID) harddrives ...
0
votes
1answer
380 views

Full Server off-site backup for a small business

I work in a small company which is getting bigger all the time. We have out grown our old backup system (a Small NAS box and Sugar Sync) and would like to move to something better... We currently ...
1
vote
3answers
458 views

Good simple VPS to S3 Backup scripts?

anyone has a nice, simple script for backing up a VPS to a S3 bucket? can be ruby, python, whatever... should be easy to configure! thanks
2
votes
2answers
520 views

AWS S3 and EBS backup?

I'm rather new to Amazon Web Services. I have a question regarding S3 and EBS. Do I have to backup an S3 or EBS service? Are these types of storage secure and backuped by amazon itself?
0
votes
1answer
273 views

How to securely backup to S3

I am using the excellent s3 tools (http://s3tools.org/s3cmd) to backup files from a Linux based server to S3. Does anyone know of a good strategy so that I can use this tool to upload o S3 in a way ...
0
votes
1answer
142 views

S3 backup: bucket vs. volume

I've inherited a project that has been pushing encrypted (GPG) DB backups via a backup script to an S3 bucket. That's all been well and good, but now that bootable EBS instances (where the project ...
0
votes
1answer
248 views

Synchronize large objects to S3 efficiently

I need to synchronize about 30GB of git repositories to S3. These repos may contain some very large pack files, on the rough order of 2GB. I know that S3 has recently added support for large objects, ...
1
vote
1answer
416 views

Does librsync really reduce bandwidth for Amazon S3

I am looking to do some backups to S3 and want to reduce the bandwidth as much as possible. I am looking at a few options. It seems like librsync is the best solution for low bandwidth remote backups. ...
0
votes
1answer
618 views

Backup script that excludes large files using Duplicity and Amazon S3

I'm trying to write an backup script that will exclude files over a certain size. My script gives the proper command, but when run within the script it outputs an an error. However if the same ...
0
votes
1answer
1k views

Amazon S3: allow users to upload on a restricted basis (per bucket maybe)?

I'm thinking about signing up to the Amazon S3 storage service. What I want to do is create a service where other people can register their own bucket with a certain amount of storage. These users ...
1
vote
2answers
310 views

Amazon cloud: What should I backup exactly?

ec2 Micro type instance comes with only EBS storage - Should I backup everything critical from there? other ec2 instances come with local storage - Should I backup everything critical from there? s3 ...
1
vote
0answers
508 views

How to backup MySql to Amazon S3?

What is the best software to use to regularly backup a MySQL database into Amazon S3? It looks like there are several solutions out there, and I am just wondering if there's a consensus on what's ...
0
votes
1answer
105 views

help me setup a good security policy

i'm running a site on a shared host while image hosting is done on amazon s3. i've opened a second shared host account for backups. here's my setup : A -> site on shared host, pushes images to B (s3 ...
0
votes
1answer
489 views

S3sync not working

I managed to get s3sync to upload my test folder to Amazon S3 and can see it in the MWS Managment Console. Downloading the data back to a test folder results in the following error message: ...
0
votes
2answers
367 views

Jungle Disk vs DiskAgent

I'm looking at implementing a secure off-site data backup of about 100 GB (and growing), more than likely on Amazon S3. I haven't found many reviews of DiskAgent, has anybody had a good experience ...
5
votes
2answers
224 views

Is there software that can help me easily back up my data from Amazon S3 to my premise?

So everyone backs their stuff up to the cloud. But I want to back up my stuff from the cloud. For a planned SaaS service, users are saving files containing their intellectual property and we're ...
3
votes
1answer
241 views

Automated backup of S3 to another cloud

Is there a service out there to auto backup our S3 account to a external cloud?
6
votes
4answers
2k views

What is a practical way to mirror an Amazon S3 bucket?

I want to mirror my Amazon S3 buckets. I want to do this because 1) I don't want all my data only existing with one provider; and 2) in case of software error or security breach I want to have the ...
1
vote
1answer
2k views

How to upload via FTP (or alt.) to AWS S3?

A simple question about Amazon (AWS) S3 storage. Is there any other way to upload data to S3 apart from the web console interface? I have a huge amount of family photos and home videos split into ...
9
votes
3answers
2k views

What's the easiest way to back up EC2 instances automatically?

I'm worried I might log in one day and my fully configured instance has been removed. I would like to be able to back it up daily to S3 but frustratingly this is not a simple setting in the console. ...
1
vote
4answers
2k views

Most cost efficient way to backup Subversion data to S3?

I'm looking at using S3 as an offsite backup repo for my Subversion database. When I dump my SVN database, it's about 10 gigabytes. I would like to avoid the charge of uploading that data ...
3
votes
4answers
2k views

Whats the best cloud backup solution for a small scale server environment?

I have a server that runs a postgres database that contains about 200MB of data. Currently I have a cron job setup on my home computer which: ssh's into my server runs a remote script which makes a ...
1
vote
2answers
1k views

Automated incremental backups from Plesk on Centos to Amazon S3

I've done a far bit of research on this via Google and there seems to be quite a few ways of possibly doing this. I'm looking to incrementally backup new and updated files in two directories on my ...
2
votes
4answers
1k views

Full MySQL BAckup strategy

Here is our MySQL settings : 3 MySQL servers in a "replication-ring" : they're all Master and S1 is slave to S2, which is slave to S3 which is slave to S4. Up until now we would do snapshots of the ...
0
votes
1answer
65 views

Backing Up User Data when data is not in use. Should I be concerned?

This may be a dumb question. I would like to use duplicity to make backups to Amazon S3 of directories, each of which contains a different user's data. Each directory could be written to at any time. ...
6
votes
2answers
2k views

AWS S3 Backup Strategies - How should I approach backing up S3 buckets?

I am in the process of building a web-app with potential for a massive amount of storage requirements which can be satisfied by amazon S3. My main concern is the usage of API keys on the server, and ...
3
votes
3answers
140 views

Jungledisk for backing up my Wiki and Drupal sites?

Hi would you guys suggest that I ask my webhost to install Jungledisk so that my backups would be stored to Amazon S3 as well? Do you guys know a better solution? Thanks in advace!
6
votes
5answers
600 views

Does Amazon S3 make any sort of guarantees on your data?

I've read over the agreements several times, and I can't find anything that guarantees Amazon will not lose or corrupt your data. Do they make any such guarantees? Can I trust S3 as my long term ...
3
votes
3answers
722 views

How is Amazon S3 storage billed?

Various Amazon S3 questions Hey everyone, I just got an Amazon S3 account and I am developing my production backup script / strategy and just had a few questions. Monthly Storage - how exactly is ...
11
votes
1answer
4k views

Duplicity and Amazon S3 Script

I'm looking to backup my linux server to Amazon S3 using duplicity. I found a great resource here that helped me get it setup and am using the basic script that was listed there for me and now copied ...
16
votes
6answers
9k views

AWS S3 Bucket Backups

Is there any way to recover from accidental deletions of an Amazon S3 Bucket? We've got critical info in our buckets and I need to mitigate the risk of accidental or malicious deletions of the bucket ...