This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
1answer
309 views

Simple S3 -> Glacier Backup

I'm looking to backup a few terabytes of data in our S3 buckets to Amazon Glacier. I've seen the options for "automatic archival" of S3 -> Glacier, but I'd rather it just be a simple one time dump ...
5
votes
4answers
7k views

How to schedule automatic (daily) snapshots of AWS EC2 Windows Instance?

I have some Windows servers hosted on Amazon EC2. Some run Windows Server 2003 and other run Windows Server 2008. These are EBS-backed instances. Most of the instances also have some additional ...
0
votes
0answers
133 views

Backing up files from my EC2 instance to S3

Hi I have a set of neat scripts that backup my dbs into db.sql.gz files under a folder on on ec2 host. My files are of the form (as you can see they are weekly rolling backups) ...
3
votes
1answer
1k views

I get a 403 when requesting a JS file from CloudFront

This is new to me so please excuse me if I have no idea what I'm talking about (: I'm trying to set up my own CDN with CloudFront and S3 through a subdomain by adding a CNAME to that subdomain to ...
1
vote
2answers
192 views

Is it safe to use S3 over HTTP from EC2, as opposed to HTTPS

I found that there is a fair deal of overhead when uploading a lot of small files to S3. Some of this overhead comes from SSL itself. How safe is it to talk to S3 without SSL when running in EC2? ...
1
vote
1answer
576 views

Best failover strategy for e-mail servers on AWS to ensure high availability

We have our e-mail server hosted on AWS. Last week Amazon had a failure in their East Coast region which brought down our server along with many others. We now want to implement a failover strategy ...
3
votes
1answer
948 views

S3 CORS through CloudFront not working in Firefox

I am using S3 CORS for serving fonts. If S3 domain name is used for serving fonts, it works in Firefox, but when CloudFront is used, it doesn't. Works with Google Chrome. My CORS configuration on S3 ...
0
votes
2answers
497 views

How to make s3fs work with IAM roles?

We are using IAM roles to maintain the machines. We now planning to mount the s3 to our ec2 instances and do the processing as per our need. We been using s3fs tool for mounting. But that doesn't ...
2
votes
3answers
503 views

How to maximize parallel download from S3

I got a lot of images to load from Amazon S3 on a single page, and sometimes it takes quite some time to load all the images. I heard that splitting the images to load from different sub-domains would ...
1
vote
1answer
256 views

Creating url from the cloudfront aws

I have my js files which I have uploaded into the Amazon S3 and linked it with the Cloudfront. I got a url something like this : dxxxxxxxx.cloudfront.net But opening that url in my browser ( I'm ...
0
votes
1answer
578 views

Can Varnish cache S3 objects?

Just a quick question: Can Varnish cache S3 objects? Or it only works for static files on the server?
2
votes
1answer
107 views

Performance issue in using Amazon S3 for run-time updates

I have a web application hosted in Amazon EC2 as well as in Rackspace. Users can upload files through this application and also modify them. Those files are stored in local storage in each of these ...
0
votes
0answers
155 views

s3fs not maintaining uid/gid

I'm mounting s3 using s3fs with the following command: sudo /usr/local/bin/s3fs -o use_cache=/tmp,uid=1000,gid=1000,allow_other svn.domain.com /svn Allow_other is confirmed to be working along with ...
0
votes
1answer
149 views

EC2 user-data and private s3 resources

I would like to set a user-data script on my EC2 instances like this: #include http://mybucket.s3.amazonaws.com/myapp/environment/aws_init.sh However the resource is acl private and cannot be ...
1
vote
1answer
82 views

More than one CNAME for S3 website

Is it possible to have more that one CNAME for amazon web services S3 web site? In docs it is said that bucket name should be equal CNAME. mysite.com and www.mysite.com as aliaces do I need to ...
1
vote
3answers
2k views

What is the difference between Buckets and Folders in Amazon S3?

What is the difference between Buckets and Folders in Amazon S3 ? Is such a thing like Folder exist in Amazon S3 ? or only the S3 clients present Folders to us for better handling ?
3
votes
2answers
294 views

“Unexpected EOF while looking for matching ``” on cron job

I set up a cron job on my server running RedHat 4.1 to backup MySQL databases, and then upload to Amazon S3. The goal is to drop the .bz2 file in a folder corresponding with the day of the week. ...
1
vote
2answers
143 views

Store profile image of all users into single directory or per subdirectory id?

I'm using amazon s3 as storage for users profile pic. I see that many websites generates large random filenames and put them into the same root directory like: ...
1
vote
1answer
238 views

Can a S3 mount be used as the document root for Apache?

Has anyone been successful in having their DocumentRoot reside on an S3 mount (using s3fs)? I currently have a mounted bucket at /mnt/s3. I can read and write files to it no problem. In my ...
1
vote
1answer
211 views

How do I delete aws s3 bucket policy?

I've mistakenly configured a bucket policy with a name of nonexisting bucket (via cloudformation). Now I can't delete the stack (S3::DeleteBucketPolicy failed), and can't find any way to delete the ...
0
votes
1answer
663 views

URL Rewriting on a S3 Bucket

Is there anyway at all to setup URL rewriting for a static-hosted website on S3? I'm in the process of migrating over an existing website and some of the URLs I would like for them to have a 301 ...
0
votes
1answer
492 views

Add S3 Bucket as a network drive [closed]

I'm using windows and I need to add my s3 buckets as a network drive on my system. I've found 3 applications: webdrive, tntdrive and gladient. I want to know the idea behind doing this so I could do ...
7
votes
4answers
7k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
2
votes
2answers
1k views

rsnapshot to Amazon S3?

I'm looking at rsnapshot and S3 to backup my server. But since rsnapshot can't directly upload to S3, and I'm not sure if S3 preserves file permissions, I'm thinking of archiving the backup folders ...
-2
votes
1answer
791 views

file transfer between s3 and ec2

I want to automate transfer of tomcat log files from micro instance to S3 account. However, all the scripts I find online use key pair in order to do this. I cant upload these key pair to the server ...
1
vote
1answer
208 views

Moving an Application to Amazon EC2 with S3

Recently I have created a web application. The application has some static parts (libraries, classes etc) and dynamic parts (images, cache, log etc) as well. However, some static parts of the app ...
0
votes
1answer
2k views

Nginx static content with Amazon S3

Im using Nginx front-end server in front of glassfish app. server. I uploaded my static contents to Amazon S3. I need to implement passing static request to Amazon's URL. I did a conf file like below. ...
3
votes
3answers
3k views

What's the best way to backup cPanel WHM server to Amazon S3? [closed]

I would like to archive cPanel backups to Amazon S3 instead of FTP. I've done some googling, but I'm not finding anything authoritative. I found the following options: whms3backup.com - $250 for ...
0
votes
1answer
387 views

Disallow Deletion from S3 Bucket [closed]

I am wanting to create a S3 bucket that does not allow for the deletion of files. Does anyone know how I am able to achieve this?
-1
votes
1answer
187 views

Serving static site with Amazon S3 [closed]

I want to host my static site www.something.com on Amazon S3. I've followed these instructions however I'm still having trouble. Specifically when I browse to www.something.com I'm sent to whatever my ...
0
votes
1answer
123 views

DNS to an Amazon S3 bucket suddenly stopped working

My fairly ignorant opinion is this is some kind of DNS problem although I've made no DNS changes for weeks. Maybe S3 is having a problem but no one seems to be reporting and S3 issues. Sometime last ...
0
votes
1answer
274 views

Is whitelisting a CNAME enough?

We are working on setting up a list of domain names we need to have whitelisted for educational institutions who use our site. We are using AWS S3 as well as cloudfront. In our cloud front, we ...
1
vote
1answer
183 views

Point S3 bucket to top level domain?

I'm able to point a custom bucket named media.example.com to http://s3.amazonaws.com/media.example.com by creating a dns entry media > cname > http://s3.amazonaws.com/media.example.com on my ...
1
vote
0answers
251 views

s3fs-mounted S3 bucket shows bad filesizes

Background: I have an Amazon S3 bucket with data uploaded using the AWS web interface. Now I need to give permissions-based access to paths within my buckets to FTP users. To do this, I'm running ...
1
vote
3answers
332 views

Backing up data (including mysqldumps) to S3

We have a web app on a number of servers and we want to add an additional layer of redundancy by backing up the key data to S3. The key data is the MySQL database and a folder containing dynamically ...
3
votes
1answer
1k views

Why I'm getting MD5 Sums don't match! error?

I'm trying to upload my audit files to S3. Using s3cmd tools. I just run this command : sudo s3cmd put /var/log/audit/audit.log s3://audit-files But I get a error message like this : ...
0
votes
1answer
48 views

How to place my audit file in Amazon S3?

I have installed and configured the auditd package in Amazon Ec2 instance. I wish I need to place all the auditd log files in Amazon S3. I'm very new to Ubuntu can anyone explain me how to do it?
0
votes
1answer
47 views

Storing pages with only client-side code in S3 over full EC2?

Question: Would storing pages in S3 with only client-side code reduce costs in comparison to hosting them in Amazon's EC2? Background: Right now I use a cms to manage all of my pages and users for a ...
0
votes
1answer
164 views

Elastic Map Reduce with S3 Readonly Permissions

I'm running a few EMR jobflows, and populating hive tables directly from S3. Naturally, it would not be ideal to drop these tables, and so I'm wondering: Is it possible to run EMR jobflows such that ...
1
vote
1answer
203 views

Web client FTP server-like solution using S3

I have been tasked with setting up an FTP server to share files with our clients. I would like to forego the traditional FTP server/FTP client type of setup for one that would use S3 as the backend ...
0
votes
1answer
367 views

How to find out what's missing from my iptables, why it's blocking my AWS transfer?

I use ManageWP to backup WordPress on my VPS then upload that to Amazon S3. It's failing with "Error 503 Service Unavailable" at the upload part when I have iptables running. When the iptables ...
0
votes
1answer
136 views

Is CloudFront (backed by S3) a good way to serve user-uploaded pictures?

Is CloudFront (backed by S3) a good way to serve user-uploaded pictures? For example forum avatars. Or maybe there is a better way?
1
vote
1answer
206 views

Distributing Erlang binaries to new EC2 instances

I am using tools such as Chef and Puppet in order to bootstrap new EC2 instances. In order to autoscale, I try to keep the install times as fast as possible. For something such as Ruby, I compiled it ...
1
vote
2answers
430 views

How to get a custom Amazon s3 url?

Right now when I upload a file to my Amazon s3 buckert the url to the file looks like this: https://s3.amazonaws.com/<MY BUCKET NAME>/filename.extension I would like to use something like ...
1
vote
1answer
2k views

AWS - Status check fails when loading AMI created from snapshot

I have a running micro instance using an 8GB EBS that I've customized. To my understand there are two ways I can create an AMI from this. 1) EC2 console -> INSTANCES - Instances -> Right Click ...
1
vote
1answer
672 views

Using TntDrive to mount Amazon S3 on a Windows Amazon EC2 instance

I currently have 2 Amazon EC2 Windows Server 2008 instances setup with a load balancer. My problem now is that I need both instances to be able to access a single file system source (I'm trying to use ...
1
vote
2answers
654 views

s3fs changing s3 permissions?

My developer believes that s3fs is changing my bucket's permissions. Is this possible? I want my bucket to be public, but it keeps reverting back to private. Here's my fstab. s3fs#production ...
3
votes
1answer
701 views

Serve up s3 file with nginx

I have some static files sitting in an S3 bucket that I want to serve up from my nginx server. Basically, if a user goes to www.mywebsite.com/this/url I want to serve them up a file from the S3 ...
0
votes
1answer
241 views

Amazon S3 - can't upload files into the same folder using s3sync.exe

I'm trying to upload a file using S3sync.exe into a certain folder in my S3 bucket. This is the command line : S3Sync.exe -AWSAccessKeyId accKey -AWSSecretAccessKey secKey -RequestEndpoint ...
1
vote
2answers
76 views

How to list s3fs mounts?

How can I list the s3fs mounts that exist on an ubuntu system? I'd like to know to which bucket each mount is mapped. Specifically, I have a specific mount (e.g. ~/s3/mymount), and would like to know ...