This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
0answers
165 views

Getting a simple list of changed files from unison

I have a filesystem that is changed on two servers and also needs to be replicated to Amazon S3. Until recently, syncing the filesystem between the two servers using Unison, and then copying to S3 ...
2
votes
2answers
896 views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
144 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
2answers
310 views

Mixed Static and dynamic content site using AWS S3 and EC2

We are installing a Java web application in a EC2 running Tomcat. The application uses a folder for users pictures (static content)-> www.example.com/PICTURES We use mod_jk to exclude Tomcat from ...
3
votes
1answer
98 views

Is Amazon s3 required if am using Cloudfront for files

I am planning to host a website in Amazon Ec2 instant. I got some basics from the docs. But I have few confusions. If am using cloudfront for CDN, do i really need to server files from s3? The site ...
0
votes
1answer
238 views

s3cmd put only files that do not exist in destination bucket

I've been using s3cmd to sync local files on our server with the S3 bucket. There are over 200,000 files on the local server. Can't seem to find any documentation on the site that explains how to ...
0
votes
1answer
159 views

Amazon AWS Store Wordpress uploads on S3

I'm getting ready to move my company's website and order management application to AWS. We use wordpress as the 'face' of our company. Our order management app is for internal use. I'm using Elastic ...
3
votes
1answer
729 views

Setting up CloudFront CDN on a cookieless root domain

I have recently set up an AWS S3 bucket for my site's static content, along w/ a CloudFront distribution for my CDN. I have this working using a sub-domain. However, after running YSlow, I realized ...
2
votes
1answer
2k views

How to replace php.ini on elastic beanstalk EC2 instances for PHP?

I have been exploring Elastic Beanstalk for easy deployment of my PHP 5.4 application. For my application, I need to make changes in php.ini file. After some searching on internet i tried to use ...
0
votes
3answers
618 views

Windows with IIS serving ASP files stored at Amazon S3

We have a website that is hosted in Windows Server 2008 R2, with IIS 7.5 The webserver hosts a couple of websites developed with ASP Classic and ASPX Is there a way to host the files for the dynamic ...
2
votes
1answer
423 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
0
votes
2answers
179 views

Amazon Cloudfront, S3 and EC2

I'm trying to use Amazon Cloudfront as a CDN provider but unsure of what other services are meant to be. Do I have to use S3 and EC2 as Virtual Server to host my files and change hosting provider in ...
0
votes
1answer
191 views

Upload database backup from mysql to Amazon S3 or Glacier without creating local file

Is there a tool that makes possible to backup a Mysql database to Amazon S3 or Amazon Glacier without having o create a local file with the database contents? Something like that: mysqldump -u ...
1
vote
3answers
636 views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
0
votes
0answers
69 views

Amazon S3 - Storage Class and Server Side Encryption

Ahhh! I am using Amazon S3 for some low price storage to clear down out SAN. I created the bucket and created a root folder. I set the storage class to standard and server side encryption AES. I ...
0
votes
1answer
99 views

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and ...
1
vote
1answer
410 views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
2
votes
1answer
111 views

How do I implement IP-based export restrictions for my data stored on Amazon S3?

A little background: Corporate wants to make our downloads unavailable to U.S. export-restricted countries like North Korea, Iran, Syria, etc. Restriction by IP-block is considered good enough. (Yes, ...
0
votes
1answer
114 views

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. ...
6
votes
6answers
939 views

Does a CDN still work even when my server is down?

I am a website owner planning to use Amazon's cloudfront S3. I have been reading all the stuffs about what a CDN can do but i still have an unanswered question. Does a CDN still work even when my ...
2
votes
2answers
2k views

Why S3 website redirect location is not followed by CloudFront?

I have a website hosted on Amazon S3. It is the new version of an old website hosted on WordPress. I have set up some files with the metadata Website Redirect Locationto handle old location and ...
1
vote
1answer
2k views

How to config Amazon Route53 working without www in sub-domain

edit: Amazon now supports this. http://aws.typepad.com/aws/2012/12/root-domain-website-hosting-for-amazon-s3.html I have my domain config in Route53 at Amazon AWS exec ping command in my domain ...
1
vote
0answers
153 views

AWS S3 - Prevent object overwrite [closed]

I'm trying to speed up a transfer of images from our web server to S3. Some of the images have been uploaded already, but the process was interrupted. We've written new scripts to upload images if ...
1
vote
1answer
569 views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
0
votes
1answer
237 views

One Way Sync of a Bucket With Local Directory

I have a local directory that I would like to synchronize with an S3 bucket. I have two specific requirements: If local file is the same as the remote, do not re-transfer it to the bucket. If some ...
2
votes
1answer
285 views

Simple S3 -> Glacier Backup

I'm looking to backup a few terabytes of data in our S3 buckets to Amazon Glacier. I've seen the options for "automatic archival" of S3 -> Glacier, but I'd rather it just be a simple one time dump ...
3
votes
3answers
4k views

How to schedule automatic (daily) snapshots of AWS EC2 Windows Instance?

I have some Windows servers hosted on Amazon EC2. Some run Windows Server 2003 and other run Windows Server 2008. These are EBS-backed instances. Most of the instances also have some additional ...
0
votes
0answers
124 views

Backing up files from my EC2 instance to S3

Hi I have a set of neat scripts that backup my dbs into db.sql.gz files under a folder on on ec2 host. My files are of the form (as you can see they are weekly rolling backups) ...
3
votes
1answer
632 views

I get a 403 when requesting a JS file from CloudFront

This is new to me so please excuse me if I have no idea what I'm talking about (: I'm trying to set up my own CDN with CloudFront and S3 through a subdomain by adding a CNAME to that subdomain to ...
1
vote
2answers
173 views

Is it safe to use S3 over HTTP from EC2, as opposed to HTTPS

I found that there is a fair deal of overhead when uploading a lot of small files to S3. Some of this overhead comes from SSL itself. How safe is it to talk to S3 without SSL when running in EC2? ...
1
vote
1answer
435 views

Best failover strategy for e-mail servers on AWS to ensure high availability

We have our e-mail server hosted on AWS. Last week Amazon had a failure in their East Coast region which brought down our server along with many others. We now want to implement a failover strategy ...
2
votes
1answer
657 views

S3 CORS through CloudFront not working in Firefox

I am using S3 CORS for serving fonts. If S3 domain name is used for serving fonts, it works in Firefox, but when CloudFront is used, it doesn't. Works with Google Chrome. My CORS configuration on S3 ...
0
votes
2answers
349 views

How to make s3fs work with IAM roles?

We are using IAM roles to maintain the machines. We now planning to mount the s3 to our ec2 instances and do the processing as per our need. We been using s3fs tool for mounting. But that doesn't ...
2
votes
3answers
372 views

How to maximize parallel download from S3

I got a lot of images to load from Amazon S3 on a single page, and sometimes it takes quite some time to load all the images. I heard that splitting the images to load from different sub-domains would ...
1
vote
1answer
224 views

Creating url from the cloudfront aws

I have my js files which I have uploaded into the Amazon S3 and linked it with the Cloudfront. I got a url something like this : dxxxxxxxx.cloudfront.net But opening that url in my browser ( I'm ...
0
votes
1answer
435 views

Can Varnish cache S3 objects?

Just a quick question: Can Varnish cache S3 objects? Or it only works for static files on the server?
2
votes
1answer
104 views

Performance issue in using Amazon S3 for run-time updates

I have a web application hosted in Amazon EC2 as well as in Rackspace. Users can upload files through this application and also modify them. Those files are stored in local storage in each of these ...
0
votes
0answers
126 views

s3fs not maintaining uid/gid

I'm mounting s3 using s3fs with the following command: sudo /usr/local/bin/s3fs -o use_cache=/tmp,uid=1000,gid=1000,allow_other svn.domain.com /svn Allow_other is confirmed to be working along with ...
0
votes
1answer
101 views

EC2 user-data and private s3 resources

I would like to set a user-data script on my EC2 instances like this: #include http://mybucket.s3.amazonaws.com/myapp/environment/aws_init.sh However the resource is acl private and cannot be ...
1
vote
1answer
80 views

More than one CNAME for S3 website

Is it possible to have more that one CNAME for amazon web services S3 web site? In docs it is said that bucket name should be equal CNAME. mysite.com and www.mysite.com as aliaces do I need to ...
1
vote
3answers
1k views

What is the difference between Buckets and Folders in Amazon S3?

What is the difference between Buckets and Folders in Amazon S3 ? Is such a thing like Folder exist in Amazon S3 ? or only the S3 clients present Folders to us for better handling ?
3
votes
2answers
224 views

“Unexpected EOF while looking for matching ``” on cron job

I set up a cron job on my server running RedHat 4.1 to backup MySQL databases, and then upload to Amazon S3. The goal is to drop the .bz2 file in a folder corresponding with the day of the week. ...
1
vote
2answers
123 views

Store profile image of all users into single directory or per subdirectory id?

I'm using amazon s3 as storage for users profile pic. I see that many websites generates large random filenames and put them into the same root directory like: ...
1
vote
1answer
215 views

Can a S3 mount be used as the document root for Apache?

Has anyone been successful in having their DocumentRoot reside on an S3 mount (using s3fs)? I currently have a mounted bucket at /mnt/s3. I can read and write files to it no problem. In my ...
1
vote
1answer
181 views

How do I delete aws s3 bucket policy?

I've mistakenly configured a bucket policy with a name of nonexisting bucket (via cloudformation). Now I can't delete the stack (S3::DeleteBucketPolicy failed), and can't find any way to delete the ...
0
votes
1answer
480 views

URL Rewriting on a S3 Bucket

Is there anyway at all to setup URL rewriting for a static-hosted website on S3? I'm in the process of migrating over an existing website and some of the URLs I would like for them to have a 301 ...
0
votes
1answer
395 views

Add S3 Bucket as a network drive [closed]

I'm using windows and I need to add my s3 buckets as a network drive on my system. I've found 3 applications: webdrive, tntdrive and gladient. I want to know the idea behind doing this so I could do ...
6
votes
4answers
5k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
2
votes
2answers
861 views

rsnapshot to Amazon S3?

I'm looking at rsnapshot and S3 to backup my server. But since rsnapshot can't directly upload to S3, and I'm not sure if S3 preserves file permissions, I'm thinking of archiving the backup folders ...
-2
votes
1answer
665 views

file transfer between s3 and ec2

I want to automate transfer of tomcat log files from micro instance to S3 account. However, all the scripts I find online use key pair in order to do this. I cant upload these key pair to the server ...