1
vote
0answers
72 views

Duplicity -> S3 backup failing with “[Errno 105] No buffer space available”

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started ...
0
votes
1answer
110 views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
1
vote
0answers
94 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
0answers
207 views

s3cmd fails to put files

I'm trying to put mysql dump file on s3 bucket. It gives an error like ; sudo ./backup.sh WARNING: Module python-magic is not available. Guessing MIME types based on file extensions. ...
2
votes
2answers
1k views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
124 views

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. ...
0
votes
2answers
440 views

How to make s3fs work with IAM roles?

We are using IAM roles to maintain the machines. We now planning to mount the s3 to our ec2 instances and do the processing as per our need. We been using s3fs tool for mounting. But that doesn't ...
0
votes
1answer
126 views

EC2 user-data and private s3 resources

I would like to set a user-data script on my EC2 instances like this: #include http://mybucket.s3.amazonaws.com/myapp/environment/aws_init.sh However the resource is acl private and cannot be ...
0
votes
1answer
47 views

How to place my audit file in Amazon S3?

I have installed and configured the auditd package in Amazon Ec2 instance. I wish I need to place all the auditd log files in Amazon S3. I'm very new to Ubuntu can anyone explain me how to do it?
0
votes
1answer
162 views

Is uploading a 500mb file to s3 an expensive operation? Any way to limit cpu usage etc?

On a production server, I'm planning on uploading a single file or a set of files that may be 500 megs in size. I havent' test it just yet, but just want some opinions on whether you think this will ...
1
vote
4answers
326 views

Best practice for synchronizing sources across servers (Amazon EC2)

I'm moving from single app server to load balanced config. In the single server config I synchronized the sources by S3 cmd sync s3 every few minutes and on hostup (Scalr event) I sync the sources ...
1
vote
1answer
901 views

Mounting an S3 bucket onto a AWS Ubuntu instance issues

i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space. here are some environment info: System Info: Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual ...
0
votes
1answer
263 views

How do I backup files stored in Rackspace Cloud Files container to an Amazon s3 bucket

I'm currently storing PDF reports in a Rackspace cloud files container. These files are generated from a web application. I'm keen to find a way to sync these files to an Amazon s3 container as a form ...
3
votes
3answers
1k views

s3fs: how to force remount on errors?

I use s3fs 1.33 on Ubuntu 9.10. Regularily it gives me errors like this: rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32) rsync: close failed on ...
3
votes
1answer
4k views

How to force s3fs mount on boot

I'm using s3fs 1.33 on Ubuntu 9.10 x86. I mount it manually with this command: sudo /usr/bin/s3fs mybucket /mnt/s3/mybucket -ouse_cache=/tmp How can I force the mount on boot? I guess that I have ...
0
votes
1answer
512 views

S3sync not working

I managed to get s3sync to upload my test folder to Amazon S3 and can see it in the MWS Managment Console. Downloading the data back to a test folder results in the following error message: ...
1
vote
1answer
3k views

Should use EXT4 or XFS to be able to 'sync'/backup to S3?

It's my first message here, so bear with me... (I have already checked quite a few of the "Related Questions" suggested by the editor) Here's the setup, a brand new dedicated server (8GB RAM, ...