This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

3
votes
0answers
1k views

Amazon S3 + Cloudfront VS Rackspace CloudFiles [closed]

I know this question came up lot of time on the internet , But I couldn't find any latest updates on this . So I gathered the information what I found and putting here and have few questions on it . ...
1
vote
2answers
2k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
1answer
448 views

Automatically sync git repo to Amazon S3 site

I'm using an Amazon S3 site to host a website. I'm aiming to use a git repo to store the content and versioning and I'd like the repo to automatically update the S3 site once something is checked into ...
2
votes
1answer
996 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
1answer
196 views

S3 bucket alias

I have a S3 bucket called "abcd" that I would like to map to a subdomain, "abcd.mydomain.com", using a CNAME. Unfortunately I can't move files from the original "abcd" bucket to a new ...
0
votes
1answer
557 views

AWS EC2 Mailserver Failover Strategies done right

I'm researching in this topic really hard the last few days and i just want to discuss this with a few specific questions - i did not find any suitable thread here that is covering my needs and ...
0
votes
1answer
156 views

How continue sync with S3CMD after broken connection?

I'm using s3cmd to backup some logs into Amazon S3 buckets. Which is a great tool. But I notice that, very often, my sync's are broken, they just cancel and try to upload again, until they can upload ...
0
votes
0answers
468 views

s3cmd fails to put files

I'm trying to put mysql dump file on s3 bucket. It gives an error like ; sudo ./backup.sh WARNING: Module python-magic is not available. Guessing MIME types based on file extensions. ...
0
votes
0answers
41 views

Cloudformation Resource for a Cross Region S3 bucket policy [duplicate]

I know this is somewhat a duplicate of Cross Region S3 bucket policy but I don't have enough rep to comment and the answer wasn't detailed enough. I would like to allow EC2 servers based in ...
3
votes
2answers
476 views

Storing and serving files securely for multiple clients

We are working on a web app, where (among other features) our users can upload their files. However we can't store these files on our VPS because storage space is limited, so we decided to go with S3. ...
0
votes
1answer
39 views

To run python script when my Amazon instance boots up

Where should i place my script in amazon instance such that my script should run when my instance boots up? I tried placing it in rc.local but it didnt help. My script is about connecting to Amazon ...
0
votes
1answer
513 views

Unable to read S3 file from interactive pig job flow

I'm unable to read a simple test file on S3 from an interactive pig job flow (hadoop, elastic map reduce), and I'm not sure why. I have two S3 buckets. Let's call them unmounted_bucket, and ...
2
votes
1answer
500 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
0
votes
2answers
2k views

Create 301 Redirection in Amazon Route 53 for Wildcard Subdomains

My domain name hosted on Route 53 DNS. Amazon has a guide to do 301 redirection for www. To naked domain by point www. version to a S3 static website with 301 setted up. My question is, how can I ...
0
votes
1answer
382 views

Configure subdomain to point to S3 bucket using Route 53

How would I go about mapping files.example.com to an Amazon S3 bucket using Amazon's Route 53 service? I've attempted to add a CNAME record but I get the following:
1
vote
2answers
365 views

Taking Cassandra Backups

We currently have 12 nodes running in our Cassandra cluster. Ultimately even if a couple of the nodes go down, we're still up and running. The paranoia in me would like to do at least one backup a day ...
1
vote
1answer
558 views

How can I download an S3 binary file using Amazon's AWS CLI tool?

I am trying to download a binary file from an AWS S3 bucket using Amazon's new command-line interface. However, the tool responds with an error message. $ aws s3 get-object --bucket myBucketName ...
0
votes
0answers
919 views

How can I move s3 objects >5gb from one bucket to another?

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using ...
-2
votes
1answer
282 views

Which is better - AWS S3 or EBS? [closed]

I am trying to create a system where users can upload their data (audio, text) which can run into around 200 MB per user. I am trying to figure out what is the best way to go ahead - using S3 or EBS. ...
0
votes
1answer
108 views

Empty /mnt: store-backed instance launch from EBS-backed AMI

I have an EBS AMI which I want to publish in AWS Market Place. The AMI was created with data in /mnt. The snapshop includes both /dev/sda1 and /dev/sdb devices : Block Devices: ...
0
votes
1answer
139 views

Copy files over to s3 from ec2 instance

I have an FTP running on my ec2 instance and I'll like to move over those files (after some processing) to s3. Lots of posts on this to either use the Amazon .NET, php or python APIs or use a 3rd ...
0
votes
1answer
166 views

What sort of delay is there between reading an Amazon S3 object from an EC3 instance

I have a REST web service that contains a /image/view/ resource that displays an image. The image is currently stored as an object in Amazon S3. When /image/view/ is accessed, the web service ...
0
votes
1answer
116 views

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to ...
0
votes
0answers
271 views

Getting a simple list of changed files from unison

I have a filesystem that is changed on two servers and also needs to be replicated to Amazon S3. Until recently, syncing the filesystem between the two servers using Unison, and then copying to S3 ...
2
votes
2answers
2k views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
375 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
2answers
644 views

Mixed Static and dynamic content site using AWS S3 and EC2

We are installing a Java web application in a EC2 running Tomcat. The application uses a folder for users pictures (static content)-> www.example.com/PICTURES We use mod_jk to exclude Tomcat from ...
4
votes
1answer
119 views

Is Amazon s3 required if am using Cloudfront for files

I am planning to host a website in Amazon Ec2 instant. I got some basics from the docs. But I have few confusions. If am using cloudfront for CDN, do i really need to server files from s3? The site ...
0
votes
1answer
597 views

s3cmd put only files that do not exist in destination bucket

I've been using s3cmd to sync local files on our server with the S3 bucket. There are over 200,000 files on the local server. Can't seem to find any documentation on the site that explains how to ...
0
votes
1answer
378 views

Amazon AWS Store Wordpress uploads on S3

I'm getting ready to move my company's website and order management application to AWS. We use wordpress as the 'face' of our company. Our order management app is for internal use. I'm using Elastic ...
3
votes
1answer
1k views

Setting up CloudFront CDN on a cookieless root domain

I have recently set up an AWS S3 bucket for my site's static content, along w/ a CloudFront distribution for my CDN. I have this working using a sub-domain. However, after running YSlow, I realized ...
2
votes
1answer
3k views

How to replace php.ini on elastic beanstalk EC2 instances for PHP?

I have been exploring Elastic Beanstalk for easy deployment of my PHP 5.4 application. For my application, I need to make changes in php.ini file. After some searching on internet i tried to use ...
0
votes
4answers
1k views

Windows with IIS serving ASP files stored at Amazon S3

We have a website that is hosted in Windows Server 2008 R2, with IIS 7.5 The webserver hosts a couple of websites developed with ASP Classic and ASPX Is there a way to host the files for the dynamic ...
2
votes
1answer
868 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
0
votes
2answers
322 views

Amazon Cloudfront, S3 and EC2

I'm trying to use Amazon Cloudfront as a CDN provider but unsure of what other services are meant to be. Do I have to use S3 and EC2 as Virtual Server to host my files and change hosting provider in ...
0
votes
1answer
352 views

Upload database backup from mysql to Amazon S3 or Glacier without creating local file

Is there a tool that makes possible to backup a Mysql database to Amazon S3 or Amazon Glacier without having o create a local file with the database contents? Something like that: mysqldump -u ...
1
vote
3answers
1k views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
0
votes
1answer
121 views

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and ...
1
vote
1answer
1k views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
2
votes
1answer
183 views

How do I implement IP-based export restrictions for my data stored on Amazon S3?

A little background: Corporate wants to make our downloads unavailable to U.S. export-restricted countries like North Korea, Iran, Syria, etc. Restriction by IP-block is considered good enough. (Yes, ...
0
votes
1answer
184 views

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. ...
7
votes
6answers
1k views

Does a CDN still work even when my server is down?

I am a website owner planning to use Amazon's cloudfront S3. I have been reading all the stuffs about what a CDN can do but i still have an unanswered question. Does a CDN still work even when my ...
3
votes
2answers
4k views

Why S3 website redirect location is not followed by CloudFront?

I have a website hosted on Amazon S3. It is the new version of an old website hosted on WordPress. I have set up some files with the metadata Website Redirect Locationto handle old location and ...
1
vote
1answer
4k views

How to config Amazon Route53 working without www in sub-domain

edit: Amazon now supports this. http://aws.typepad.com/aws/2012/12/root-domain-website-hosting-for-amazon-s3.html I have my domain config in Route53 at Amazon AWS exec ping command in my domain ...
1
vote
1answer
1k views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
0
votes
1answer
427 views

One Way Sync of a Bucket With Local Directory

I have a local directory that I would like to synchronize with an S3 bucket. I have two specific requirements: If local file is the same as the remote, do not re-transfer it to the bucket. If some ...
2
votes
1answer
366 views

Simple S3 -> Glacier Backup

I'm looking to backup a few terabytes of data in our S3 buckets to Amazon Glacier. I've seen the options for "automatic archival" of S3 -> Glacier, but I'd rather it just be a simple one time dump ...
5
votes
5answers
12k views

How to schedule automatic (daily) snapshots of AWS EC2 Windows Instance?

I have some Windows servers hosted on Amazon EC2. Some run Windows Server 2003 and other run Windows Server 2008. These are EBS-backed instances. Most of the instances also have some additional ...
3
votes
1answer
2k views

I get a 403 when requesting a JS file from CloudFront

This is new to me so please excuse me if I have no idea what I'm talking about (: I'm trying to set up my own CDN with CloudFront and S3 through a subdomain by adding a CNAME to that subdomain to ...
1
vote
2answers
257 views

Is it safe to use S3 over HTTP from EC2, as opposed to HTTPS

I found that there is a fair deal of overhead when uploading a lot of small files to S3. Some of this overhead comes from SSL itself. How safe is it to talk to S3 without SSL when running in EC2? ...